Skip to content

Worker part of the Web Crawler application. The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.

Notifications You must be signed in to change notification settings

almoggutin/web-crawler-worker-node-js

Repository files navigation

Web Crawler Worker Side

Worker side of the Web Crawler Application

< Technologies /> 💻

Frontend Technologies:

  1. HTML5
  2. CSS3
  3. Javascript
  4. Handlebars.js

Backend Technologies:

  1. Node.js
  2. Express
  3. Cors
  4. AWS
  5. Redis
  6. Jest
  7. Node html parser

Scaling Services:

  1. Dcoker
  2. Kubernetes

< Repositories />

  1. Web Crawler Full App
  2. Client Side
  3. Server Side

About

Worker part of the Web Crawler application. The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published