Web Scraper in Go, similar to BeautifulSoup
-
Updated
Aug 17, 2020 - Go
{{ message }}
Web Scraper in Go, similar to BeautifulSoup
a class that uses scraped proxies to make http GET/POST requests (Python requests)
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
An R web crawler and scraper
Scrapes g4g and creates PDF
A php crawler that finds emails on the internets
Cryptocurrency Historical Market Data R Package
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
A command line tool for checking your website for GDPR compliance.
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
A tkinter GUI collating various data
Speedy, lightweight web scrapper for Shutterstock.
This Python script will download chapters from novels availaible on wuxiaworld.com saves then into the .epub format
Financial Web Scraper & Sentiment Classifier
An automated, programming-free web scraper for interactive sites
Nunux Keeper core API
MakeNews is for journalists and newsrooms. It helps you track news from web and social media in real-time.
Library packs for google cloud functions
A web scraping tool to allow freeCodeCamp campers to download their solutions.
Python script/class to download an entire Imgur album in one go into a folder of your choice.
A Linux terminal tool for parsing and scraping Holberton project pages to automate repetitive tasks.
Web data extraction tool implemented as chrome extension
This is an unofficial API for the website pcpartpicker.com.
Python client for RealClearPolitics.
a java library which scrapes twitter to fetch publicly available info
Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website
[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Add a description, image, and links to the webscraper topic page so that developers can more easily learn about it.
To associate your repository with the webscraper topic, visit your repo's landing page and select "manage topics."
We need more tests. Contributions are welcome!