Skip to content

Full app of the Web Crawler application. The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.

Notifications You must be signed in to change notification settings

almoggutin/web-crawler-full-app

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Web Crawler App

The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.

< Technologies /> 💻

Frontend Technologies:

  1. HTML5
  2. CSS3
  3. Javascript
  4. Handlebars.js

Backend Technologies:

  1. Node.js
  2. Express
  3. Cors
  4. AWS
  5. Redis
  6. Jest

Scaling Services:

  1. Dcoker
  2. Kubernetes

< Repositories />

  1. Client Side
  2. Server Side
  3. Wroker Side

About

Full app of the Web Crawler application. The Web Crawler app takes an input from the user such as a link maximum number of pages and depth. At the end it shows in real time a tree of all the links and pages that the crawler found in the provided URL.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published