A web crawler made in python that is capable of searching a keyword upto 3 levels of a particular website including BBC, Facebook, Youtube etc.
- Download using the command git clone
- Using the cmd run the file using the command
python web_crawler.py
- The crawler will ask you to enter an http/www link
- Enter the keyword you can to search from a particular website
- You will input the level you want the webcrawler to crawl
- Press enter and enjoy the show while it saves the results obtained in a .log file
- Multi threading
- Scheduling
- File handling
- Url rendering
- Interruption signals
Feel free to give a star to this powerful project and support! :)