CrawlerWave

A fluent Lib to wrap selenium and other utilities for a web crawler.

Pipeline

Metrics

Usage

Simple Url nagigation example:

var crawler = new Crawler(logFactory);

crawler.Initialize(new Behavior())
       .GoToUrl("https://github.com/afborgesDev/CrawlerWave", out _);

Get Element text

var crawler = new Crawler(logFactory);

crawler.Initialize(new Behavior())
       .GoToUrl("https://github.com/afborgesDev/CrawlerWave", out _)
       .ElementInnerText(WebElement.xPath("//*[@id='js-repo-pjax-container']/div[1]/div/h1"), out var elementText);

More Examples on Tests or on Wiki(WIP)