-
-
Notifications
You must be signed in to change notification settings - Fork 60
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GoogleScholarScraper::ScrapeDoc doesn't work #114
Labels
Milestone
Comments
GerHobbelt
added a commit
to GerHobbelt/qiqqa-open-source
that referenced
this issue
Oct 19, 2019
GerHobbelt
added a commit
to GerHobbelt/qiqqa-open-source
that referenced
this issue
Oct 19, 2019
…not work for users living outside US/UK. Also further fixes jimmejardine#114. Also fixes jimmejardine#117 by enforcing UTF8 encoding on the content: we're downloading from Google Scholar there, so we should be good. Google Scrape finally finds decent titles, author lists and even PDF download links once again. TODO: update the 'Google Scholar' view part in the PDFReader control.
GerHobbelt
added a commit
to GerHobbelt/qiqqa-open-source
that referenced
this issue
Oct 19, 2019
GerHobbelt
added a commit
to GerHobbelt/qiqqa-open-source
that referenced
this issue
Oct 19, 2019
…der left pane -- this is where most of the scrape info lands. ( jimmejardine#114 / jimmejardine#115 / jimmejardine#117 )
GerHobbelt
added a commit
to GerHobbelt/qiqqa-open-source
that referenced
this issue
Oct 19, 2019
… made it through in the previous fix commit for jimmejardine#114 / jimmejardine#115 : this corrects/augments these commits: SHA-1: 65e5707 + SHA-1: a5faaaf
As .NET only supports XPath 1.0 the Binging on SO:
|
Fixed in dev repo for v82 release: https://github.com/GerHobbelt/qiqqa-open-source/tree/v82-build |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
The first line in there:
always delivers NULL.
Nett result: Google Scholar Scrape activity will never deliver anything.
Analysis / Resolution
https://stackoverflow.com/questions/13771083/html-agility-pack-get-all-elements-by-class
vs. Google Scholar spitting out HTML like this:
(after pulling the HTML through an online formatter which very probably b0rked the Unicode in there...)
shows that the solution can be had from the last SO answer:
The text was updated successfully, but these errors were encountered: