Summary

The goal of this project was to implement a PageRank algorithm that determined the most important subreddits on reddit through link analysis. To accomplish this, we implemented a web crawler, crawled reddit, parsed the html utilizing Java's jsoup library, stored the needed data to calculate PageRank in a SubRedditNode object, and then calculated the importance of each subreddit page we crawled based off of the number of incoming and outgoing links. (See https://www.geeksforgeeks.org/page-rank-algorithm-implementation/ for math details.)

Requirements

JDK 1.8 or above must be installed
JDK bin set as PATH

Compile:

javac -cp PageRank\lib\*.jar -d out\production\PageRank PageRank\src\*.java

Execute:

java -cp "PageRank\lib\*;out\production\PageRank" PageRank\src\CrawlerTest.java
OR 
java -cp "PageRank\lib\*;out\production\PageRank" PageRank\src\CrawlerTest.java [NUMBER] [SUBREDDIT]

Arguments:

Prompt user for number of sites input
Prompt user for root SubReddit to crawl
OR
Where [NUMBER] is number of sites to visit
Where [SUBREDDIT] is root SubReddit to crawl 

Output:

Print the pages visited
Number of pages unable to visit
Outgoing links from Subreddit
PageRank links from list
PageRank ordered