Scrape the product reviews and store them in a database.
- This project scrapes the reviews of the products from Flipkart and stores them in a database to avoid scraping for the same product at a later point in time.
- Provides user interface
- Interactive graphical representation of ratings
Clone this repo using
git clone https://github.com/Anil-45/ReviewScraper.git
Install the required modules using
pip install -r Requirements.txt
To use SQL database, generate a config file using generate_config.py
.
Open generate_config.py
and edit host, username and password.
config_file.set(DATABASE, HOST, "127.0.0.1")
config_file.set(DATABASE, USERNAME, "root")
config_file.set(DATABASE, PASSWORD, "root")
Once you are done editing, run:
python generate_config.py
Alternatively, you can also edit config.ini
.
You can run the project without a database also, but the results for the products will always be scraped.
Run the app:
python app.py
You can find all the logs in .log
files
- Add support for different databases.
Created by @Anil_Reddy
This project is available under the MIT.