COLLECTED BY

Organization: Archive Team

Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.

History is littered with hundreds of conflicts over the future of a community, group, location or business that were "resolved" when one of the parties stepped ahead and destroyed what was there. With the original point of contention destroyed, the debates would fall to the wayside. Archive Team believes that by duplicated condemned data, the conversation and debate can continue, as well as the richness and insight gained by keeping the materials. Our projects have ranged in size from a single volunteer downloading the data to a small-but-critical site, to over 100 volunteers stepping forward to acquire terabytes of user-created data to save for future generations.

The main site for Archive Team is at archiveteam.org and contains up to the date information on various projects, manifestos, plans and walkthroughs.

This collection contains the output of many Archive Team projects, both ongoing and completed. Thanks to the generous providing of disk space by the Internet Archive, multi-terabyte datasets can be made available, as well as in use by the Wayback Machine, providing a path back to lost websites and work.

Our collection has grown to the point of having sub-collections for the type of data we acquire. If you are seeking to browse the contents of these collections, the Wayback Machine is the best first stop. Otherwise, you are free to dig into the stacks to see what you may find.

The Archive Team Panic Downloads are full pulldowns of currently extant websites, meant to serve as emergency backups for needed sites that are in danger of closing, or which will be missed dearly if suddenly lost due to hard drive crashes or server failures.

Collection: ArchiveBot: The Archive Team Crowdsourced Crawler

ArchiveBot is an IRC bot designed to automate the archival of smaller websites (e.g. up to a few hundred thousand URLs). You give it a URL to start at, and it grabs all content under that URL, records it in a WARC, and then uploads that WARC to ArchiveTeam servers for eventual injection into the Internet Archive (or other archive sites).

To use ArchiveBot, drop by #archivebot on EFNet. To interact with ArchiveBot, you issue commands by typing it into the channel. Note you will need channel operator permissions in order to issue archiving jobs. The dashboard shows the sites being downloaded currently.

There is a dashboard running for the archivebot process at http://www.archivebot.com.

ArchiveBot's source code can be found at https://github.com/ArchiveTeam/ArchiveBot.

TIMESTAMPS

The Wayback Machine - http://web.archive.org/web/20200813032028/https://github.com/topics/workflow

#

workflow

Here are 2,299 public repositories matching this topic...

apache / airflow

Star

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

python workflow airflow scheduler apache apache-airflow

Updated Aug 13, 2020
Python

teambit / bit

Star

Build, distribute and collaborate on components.

react nodejs git graphql components workflow distributed-systems modules frontend backend reactjs bit collaboration developer-tools ui-components javscript reuse

Updated Aug 13, 2020
TypeScript

n8n-io / n8n

Star

Free and open fair-code licensed node based Workflow Automation Tool. Easily automate tasks across different services.

Updated Aug 13, 2020
TypeScript

okonet / lint-staged

Star

🚫💩 — Run linters on git staged files

stylelint git workflow eslint linter developer-experience stage-files

Updated Jul 28, 2020
JavaScript

brunch / brunch

Star

🍴 Web applications made easy. Since 2011.

javascript workflow pipeline build-automation brunch

Updated Jul 31, 2020
JavaScript

argoproj / argo

Star

Argo Workflows: Get stuff done with Kubernetes.

kubernetes workflow machine-learning airflow workflow-engine argo dag knative argo-workflows

Updated Aug 13, 2020
Go

muesli / beehive

Star

A flexible event/agent & automation system with lots of bees 🐝

workflow automation beer event-driven ifttt

Updated Jul 31, 2020
Go

petervanderdoes / gitflow-avh

Star

AVH Edition of the git extensions to provide high-level repository operations for Vincent Driessen's branching model

git shell workflow git-flow

Updated Jul 8, 2020
Shell

fuse-box / fuse-box

Star

A blazing fast js bundler/loader with a comprehensive API 🔥

javascript workflow bundler performance typescript hmr loader hot-reload

Updated Aug 11, 2020
JavaScript

PrefectHQ / prefect

Star

The easiest way to automate your data

python infrastructure workflow data-science automation workflow-engine data-engineering prefect data-ops ml-ops

Updated Aug 13, 2020
Python

pditommaso / awesome-pipeline

Star

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

workflow awesome-list

Updated Aug 11, 2020

Tencent / WeFlow

Star

A web developer workflow tool by WeChat team based on tmt-workflow, with cross-platform supported and environment ready.

gulp workflow wechat f2e weflow

Updated Mar 27, 2020
JavaScript

puckel / docker-airflow

Star

Docker Apache Airflow

docker workflow task airflow scheduler management docker-airflow

Updated Jul 29, 2020
Shell

polyaxon / polyaxon

Star

Machine Learning Platform for Kubernetes

Updated Aug 13, 2020
Python

danielgerlag / workflow-core

Star

Lightweight workflow engine for .NET Standard

workflow workflow-engine saga saga-transactions

Updated Aug 9, 2020
C#

versionpress / versionpress

Star

Git-based version control for WordPress. Whoa!

git wordpress workflow database version-control staging versionpress

Updated Jul 29, 2020
PHP

aelassas / Wexflow

Star

An easy and fast way to build automation and workflows on Windows, Linux, macOS, and the cloud.

workflow automation workflow-engine scheduler

Updated Jul 2, 2020
C#

SuiteCRM

salesagility / SuiteCRM

Star

SuiteCRM - Open source CRM for the world

quotes php workflow contacts leads crm accounts portal reports documents cases contracts suitecrm opportunities agplv3 multi-language-support multi-currency

Updated Aug 10, 2020
PHP

deanishe / alfred-workflow

Star

Full-featured library for writing Alfred 3 & 4 workflows

python caching http alfred workflow keychain fuzzy-search alfred-workflow workflows alfred-3 alfred3 alfred4 alfred4-workflow

Updated Jul 31, 2020
Python

Tencent / tmt-workflow

Star

A web developer workflow used by WeChat team based on Gulp, with cross-platform supported and solutions prepared.

javascript gulp workflow

Updated Jul 30, 2020
CSS

dagster-io / dagster

Star

A Python library for building data applications: ETL, ML, Data Pipelines, and more.

python workflow data-science scheduler data-pipelines workflow-automation dagster

Updated Aug 12, 2020
Python

jagenjo / litegraph.js

Star

A graph node engine and editor written in Javascript similar to PD or UDK Blueprints, comes with its own editor in HTML5 Canvas2D. The engine can run client side or server side using Node. It allows to export graphs as JSONs to be included in applications independently.

nodejs javascript editor workflow modular graph graphs visual canvas2d blueprints nodes visual-programming node-graph webglstudio

Updated Aug 12, 2020
JavaScript

viewflow / viewflow

Star

Reusable workflow library for Django

python workflow django workflow-engine bpmn process-engine

Updated Aug 7, 2020
Python

git-town / git-town

Star

Generic, high-level Git workflow support!

git productivity workflow command-line git-flow

Updated Aug 7, 2020
Gherkin

sindresorhus / alfy

Star

Create Alfred workflows with ease

nodejs javascript macos alfred workflow preferences framework scaffold alfred-workflow alfy ease alfred3-workflow npms alfred-updater alfred-notifier generator-alfred subtext

Updated Aug 11, 2020
JavaScript

github / octodns

Star

Tools for managing DNS across multiple providers

dns workflow infrastructure-as-code

Updated Aug 3, 2020
Python

Tencent / QMUI_Web

Star

An efficient front-end framework for developers building UI on the web.

workflow gulpfile web-ui sass-framework widget-toolkit

Updated Jul 16, 2020
JavaScript

PowerJob

KFCFans / PowerJob

Star

Powerful distributed job scheduling middleware that supports CRON, API, fixed frequency, fixed delay and other scheduling strategies, provides workflow to choreograph jobs to resolve dependencies, supports distributed computing of tasks, simple to use, powerful, well-documented, welcome you to access to use!

java workflow akka cron scheduler distributed mapreduce

Updated Aug 9, 2020
Java

ahmadawais / WPGulp

Star

An advanced & extensively documented Gulp WordPress workflow. Kick start a build-workflow for your WordPress plugins and themes with Gulp.

javascript theme wordpress-plugin workflow translation minification wpgulp wordpress-gulp-workflow

Updated Jan 18, 2020
JavaScript

camunda / camunda-bpm-platform

Star

Flexible framework for workflow and decision automation with BPMN and DMN. Integration with Spring, Spring Boot, CDI.

java workflow bpmn bpm camunda-bpm-platform process-engine camunda-engine dmn cmmn

Updated Aug 12, 2020
Java

Improve this page

Add a description, image, and links to the workflow topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the workflow topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.