An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A Python module to bypass Cloudflare's anti-bot page.

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Scrape data from websites using Open Graph, HTML metadata & fallbacks.

Scrape any website, article or RSS/Atom Feed with ease!

Scrape Instagram's API with Puppeteer

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!

Google/Bing Images Web Downloader

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

Golang pkg to quickly return a preview of a webpage (title/description/images)

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

🕷️ The PHP SERP Spider - A search engine scraper

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

MetroLyrics API for Python

scrape google search results

A sports data scraping and analysis tool

Scrape Amazon wishlist and provide an API. Play 2.5, JSoup, React.

scrapers for building your own image databases

Scrape Instagram

📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.

A NodeJS Package to scrape information from search results, including videos, channels, playlists and movies

Python Script to Scrape Pastebin with Regex.

stitch & scrape tiles from slippy map services

Shopee Scrape is a tool that functions to collect data - the data needed, such as finding data from photos, prices, names, store locations and others.

📦 R package to easily web scrape Glassdoor company reviews. Write up of demo:

Extract all CSS from a given url, both server side and client side rendered.