Scrapy, a fast high-level web crawling & scraping framework for Python.

Elegant Scraper and Crawler Framework for Golang

Pythonic HTML Parsing for Humans™

A scalable web crawler framework for Java.

Tabula is a tool for liberating data tables trapped inside PDF files

Distributed crawler powered by Headless Chrome

Declarative web scraping

Apify SDK — The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

Getting started with Puppeteer and Chrome Headless for Web Scraping

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

A browser testing and web crawling library for PHP and Symfony

Get info from any web service or page

A curated list of awesome puppeteer resources.

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

artoo.js - the client-side scraping companion.

Creating Scrapy scrapers via the Django admin interface

Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

[Unmaintained] A simple and clean video/music/image downloader 👾

✂️ High performance, multi-threaded image scraper

Free Web Scraping Tool with Java

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Simple but useful Python web scraping tutorial code.

Analyze facebook copy of your data with ruby language. Download zip file from facebook and get info about friends ranking by message, vocabulary, contacts, friends added statistics and more

Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)

A framework for creating semi-automatic web content extractors

Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.

Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)

Extract structured data from web sites. Web sites scraping.

COVID-19 Coronavirus data scraped from government and curated data sources.