Skip to content

Latest commit

 

History

History
52 lines (27 loc) · 1.54 KB

README.md

File metadata and controls

52 lines (27 loc) · 1.54 KB
Raw

ScraGit

FIGLET

It's a simple tool permitting to extract emails from websites and search for a special query in github commits using Github Search API

Disclaimer: This tool is for educational purposes only! Use it at your own risk

Idea

A lot of unaware developers forget the session Secret Key or JWT key hardcoded in their projects when they publish it in Github , so to become more familiar with bash scripting i decided to develop this little tool that do some basic search in github commits. It also extracts emails from a list of websites .

How to Install ?

Dependencies:

jq for json parsing:

apt-get install jq

Now you only have to clone the project and start scraping \o/

How to use ?

HELP

Extracting Emails

-1) You have to specify the file containing the websites from which you will extract the emails using -f or --file option

-2) You have to specify --extract email or -e email

-3) It's optional but you can specify where to output the results using **--output-- or -o

Searching in Github commits

-1) You have to specify --github option

-2) You have to specify the query option using -q or --query or the default one will be used ("secret_key")

-3) It's optional but you can specify where to output the results using **--output-- or -o

TODO

  • Support Shodan

  • Improve Github Search API usage

  • Extract other informations from websites

  • Add recursive option in extracting