ScrapingBot

A scraping bot with python using the selenium library and pandas.
Based on How to Code a Scraping Bot with Selenium and Python.

Installation

• Use the package manager pip to install Selenium, pandas and lxml.

pip install selenium
pip install pandas
pip install lxml

• Google Chrome
• ChromeDriver (make sure it matches the browser's version)
  Extract executable in C://Users//{username}//AppData//Local//Programs//Python//Python{version} or C://Program Files[(x86)]?//Python{version}, depending on where you installed Python

Debugging

• Bluetooth: Getting Default Adapter Failed

Bugs

• Sometimes (but not consistently), the website will show a "Subscribe to newsletter" popup, which will break the iteration and the program will run again

TODO

1. Convert XPATH scraping to ID/CLASS/NAME, etc.
2. Return data for multiple currencies
3. Update function that receives an existing dataframe and returns historical data up to today