The Wayback Machine - http://web.archive.org/web/20201201080148/https://github.com/topics/scraper
Skip to content
#

scraper

Star

Here are 4,115 public repositories matching this topic...

Language: All
Filter by language
All 4,115 Python 1,932 JavaScript 757 Go 195 PHP 166 Ruby 157 HTML 129 Java 129 TypeScript 129 Jupyter Notebook 105 C# 83
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
ferret

MontFerret / ferret

Star
Open

Don't stop script execution on non HTTP 200

JekRock
JekRock commented Sep 19, 2020

Is your feature request related to a problem? Please describe.
Currently, there are services that secure website from automation tools like ferret. Some of them send 405 in response to the DOCUMENT function call that make a ferret script fail with an error even though a page is available (not the original page, but usually a page with the captcha).

Describe the solution you'd like
It

Read more
area/drivers good first issue help wanted type/enhancement
Find more good first issues →

alberanid / imdbpy

Star
Open

Original title must not be locale-dependant (as it's the *original* title)

1
facundobatista
facundobatista commented Feb 10, 2020

Issue description

The original title key translates the title. It should not.

Version of IMDbPY, Python and OS

  • Python: 3.6.9
  • IMDbPY: 6.9dev20200125 (installed from the repo here)
  • OS: uname_result(system='Linux', node='blackfx', release='4.15.0-76-generic', version='#86-Ubuntu SMP Fri Jan 17 17:24:28 UTC 2020', machine='x86_64', processor='x86_64')
Read more
enhancement good first issue http
Find more good first issues →

Improve this page

Add a description, image, and links to the scraper topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the scraper topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.