GitHub - Santosh01/Jsoup_Web_Crawler: Implemented this application to fetch the results (link and title) from Yahoo, Wikipedia, Bing with their corresponding IDs also some added features like - (i) User can find the keywords from fetched results (ii) User can crawl the web pages as per level of search (there are 2 level which defines how deep the crawler should crawl the web pages also it works based on the BSF algorithm). (iii) User can crawl each search engines(Bing, Wikipedia, Yahooo) either individually or simultaneously. (iv) User can remove home Pages links and lite from crawled web pages. (v) User can delete the duplicate links.

Santosh01 / Jsoup_Web_Crawler Public

Notifications You must be signed in to change notification settings
Fork 1
Star 1

Implemented this application to fetch the results (link and title) from Yahoo, Wikipedia, Bing with their corresponding IDs also some added features like - (i) User can find the keywords from fetched results (ii) User can crawl the web pages as per level of search (there are 2 level which defines how deep the crawler should crawl the web pages a…