An internet search engine written mostly in python. Currently TF-IDF based.

This project is an automated tool designed to scrape product information from Amazon's search results pages using Python and Selenium. The script is built to extract essential data such as product names and links based on a specified search query. It also includes functionality for handling pagination, allowing it to navigate through multiple pages

API to parse tibia.com content into python objects.

This Python program is a bot designed to explore establishments on Google Maps, extract data from each establishment and store it for later use in a JSON and CSV file. Added value of the fork: the establishments websites are then explored with Scrapy in order to extract and store email addresses.

This program aims to check active targets by saving screenshots in a project.

从新浪财经、每经网、金融界、中国证券网、证券时报网上，爬取上市公司（个股）的历史新闻文本数据进行文本分析、提取特征集，然后利用SVM、随机森林等分类器进行训练，最后对实施抓取的新闻数据进行分类预测

WebDiver is a versatile Python script for crawling websites, extracting internal and external links, titles, and descriptions. It's useful for tasks such as web analysis, OSINT (Open Source Intelligence) gathering, and competitive analysis.

HTTP API for Scrapy spiders

Python Library for Crawling News Artircles in Korean Top 10 News Websites with Utilities

🎥🎞️🤖 A LineBot powered by Finite State Machine (FSM) that delivers updates on the latest and popular dramas, movies, and animations.

A CLI tool to download a whole website in one click.

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

2020년 카카오톡 단체채팅방에 반복적으로 사용되는 알림 및 공지를 자동화하기 위해 Bot을 제작하였다.

🚀 주식 정보 수집 프로그램(Toy-Project)

The web scraping project to extract bussiness directory from https://www.2merkato.com/directory

Address Extraction Challenge for Veridion Internship

A scraper to get every quote from a book off of Goodreads.

A Python package to find the sitemap of a URL, even if it does not have a standard path

A Real Estate Web Crawler and data pipeline, developed using Python and Scrapy, facilitates the ETL process through multiple stages. It extracts metadata for apartments in Milan, Italy, from various web pages and URLs on sublet.com. The extracted information is then structured using Scrapy items and saved in JSON format

Get all links in all pages in one application