Logstash - transport and process your logs, events, or other data

Flow-based programming for JavaScript

生产环境的海量数据计算产品，文档地址：

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

This repository is a getting started guide to Singer.

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml formatted files)

A simplified, lightweight ETL Framework based on Apache Spark

Bender - Serverless ETL Framework

A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.

mito ETL tool

A visual ETL development and debugging tool for big data

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

Configurable Extract, Transform, and Load

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

Download DIG to run on your laptop or server.

Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Global Biotic Interactions provides access to existing species interaction datasets

Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.

A tool for building feature stores.

A simple and out-of-box toolkit to handle data work

A realtime ETL engine

Knowledge Graph Toolkit

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

A SQL-like language for performing ETL transformations.

Command line tool to run batch jobs concurrently with ETL framework on AWS or other cloud computing resources

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/