Auto_WebCrawler.exe

It is a code that can be crawled on Google and Naver, and can be executed directly as a code, and can be converted into an executable file and used.

Demo

Getting Started

• Check your chrome version and download the correct chromedriver for your version
  
• Check your chrome version link --> chrome://settings/help
  
• Other chromedriver download link --> https://chromedriver.chromium.org/downloads
  
• The chromedriver included in the repo is 87.0.4280.88
  
• If you download another chromedriver, replace it with the repo's chromedriver.
  

Download git and install module

git clone https://github.com/cjf8899/WebCrawler_exe.git

cd WebCrawler_exe

pip install pyinstaller

pyinstaller --onefile main.py

cd dist

cp -r ../chromedriver .

the structures would like

~/WebCrawler_exe/
    -- chromedriver
      --chromedriver.exe
    --dist
      --main.exe
      --chromedriver
        --chromedriver.exe
    --collect_links.py
    --keywords.txt
    --LICENSE
    --main.py
    --requirements.txt
    ...

Enter the main.exe file and run it!

Development Environment

• Windows 10
• Python
• Visual Studio Code

Referenced. Thank you all

code : https://github.com/YoongiKim/AutoCrawler