Metacritic is a website that aggregates reviews of films, television shows, music albums, video games, and formerly books. Due to its large quantity of high-quality rating data and multiple dimensions, it has good research value.

🕹️ In AIDM 7360 Group Project, we mainly focus on the game rating.This repository provides specific web-crawling code and some data acquisition processes, different web-crawling code files target different webpage content.

• Spider_every_year.py & Spider_every_game.py  

For example, in 2023, by crawling all the URLs of each game in 2023 through the previous web page, visit and crawl further related data for each game URL. The game data we crawl includes but is not limited to the following:  

• every_critic_new.py

By accessing all media review page tags, obtain the ratings and evaluations of the game from the media and related individuals.

 

 

 

In actual operation, some code will be slightly adjusted