ersinaksar / Network-of-Websites Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

Python command-line script that will be able to get all website page links from starting website START_URL with a max depth of DEPTH. The network of website URLs stored in the Memgraph database. The script also able to find the shortest path from START_URLto E ND_URLfrom a scraped network of websites in the Memgraph database.

GPL-3.0 license

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
LICENSE		LICENSE
README.md		README.md
main.py		main.py

Repository files navigation

Network-of-Websites

docker image tag memgraph mem

docker run -p 7687:7687 -v /yourlocation/data:/var/lib/memgraph mem

docker run mem

Example Run

python main.py delete

python main.py network https://memgraph.com

python main.py path https://memgraph.com https://discourse.memgraph.com

About

Python command-line script that will be able to get all website page links from starting website START_URL with a max depth of DEPTH. The network of website URLs stored in the Memgraph database. The script also able to find the shortest path from START_URLto E ND_URLfrom a scraped network of websites in the Memgraph database.

scraper command-line python3 scraping-websites beatifulsoup web-page-parsing memgraph

GPL-3.0 license

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%