web-archiving

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

Collect and revisit web pages.

Core Python Web Archiving Toolkit for replay and recording of web archives

InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS

Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)

Indelible links

Archiveror will help you preserve the webpages you love. 💾

A Tool To Push Web Resources Into Web Archives

🐋 Web Archiving Integration Layer: One-Click User Instigated Preservation

Streaming WARC/ARC library for fast web archive IO

Serverless Web Archive Replay directly in the browser

A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!

Wayback Machine API interface & a command-line tool

Chrome extension to "Create WARC files from any webpage"

Social Feed Manager user interface application.

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

🐋 One-Click User Instigated Preservation

A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine

Perpetual Access To The Scholarly Record

Desktop Electron app for ArchiveBox internet archiver. (ALPHA: not ready for general use)

Parse And Create Web ARChive (WARC) files with node.js

A server to collect & archive websites that also supports video downloads

A Memento Aggregator CLI and Server in Go

🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.

Web archive index server based on RocksDB

Converts HTTrack crawls to WARC files

CDXJ Indexing of WARC/ARCs

Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki

Homebrew formula for the ArchiveBox self-hosted internet archiving solution.

A PDF classifier ensemble with REST API service