GitHub - simplecto/sitemap_grabber: A python library to recursively crawl every sitemap.xml and every url in those sitemaps.

simplecto / sitemap_grabber Public

A python library to recursively crawl every sitemap.xml and every url in those sitemaps.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 44 Commits
.idea		.idea
sitemap_grabber		sitemap_grabber
tests		tests
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
LICENSE		LICENSE
README.md		README.md
SECURITY.md		SECURITY.md
SUPPORT.md		SUPPORT.md
pyproject.toml		pyproject.toml
requirements-dev.txt		requirements-dev.txt
requirements.txt		requirements.txt