简单易用的Python爬虫框架，QQ交流群：597510560

ACHE is a web crawler for domain-specific search.

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

The simple, easy to use command line web crawler.

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

A simple distributed crawler for zhihu && data analysis

Web spider as a service, spider on serverless, the engine behind kmppp.com

Tool made to automate tasks of pentesting.

企业信息爬虫，关键字爬取公司信息

talospider - A simple,lightweight scraping micro-framework

user profile of jiayuan.com

网络爬虫模拟登陆bilibili 滑动验证码的破解 弹幕发送 2018-10-9

哔哩哔哩（https://www.bilibili.com ）读取楼层，发送评论，抢楼，抢沙发

2018年底到2019上半年，通过抓包工具发现好看视频的参数签名漏洞，并成功利用刷金币兑换现金，持续半年。

Open WEB spider platform

web crawler allowing full page render crawl using HtmlUnit

Code and slides for my class: Data Gathering & Wrangling

a data mining and machine learning repo

A web crawling library written in TypeScript.

Use Word2vec model and LDA model for drug recommendation

multi-threaded webs crawler

A program that browses facebook or twitter to download video from a public post/tweet

Contains scripts used to learn, test and explore web spiders or crawlers, which are tools used to index / explore various web sites and content.

Web spider and take screenshot

Performs useful checks against a website, such as 404 errors reporting, structured data validation...

a simple python written url fuzzer

use scrapy to crawl weibo

Internet hot topic detection and tracking system

Web spiders are usually disliked by websites, but useful for recursive API/page downloads for offline analysis.