Apache Avro is a data serialization system.

Record Query - A tool for doing record analysis and transformation

Confluent Schema Registry for Kafka

Avro for JavaScript ⚡

Apache Kafka and Confluent Platform examples and demos

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

Avro schema generation and serialization / deserialization for Scala

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Iceberg is a table format for large, slow-moving tabular data

Web tool for Avro Schema Registry |

80+ DevOps & Data CLI Tools - AWS, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, Ambari, Blueprints, CloudFormation, Elasticsearch, Solr, Pig, IPython - Python / Jython Tools

A tool for data sampling, data generation, and data diffing

Divolte Collector

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro & Excel data files

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

**Unofficial / Community** Kafka Connect MongoDB Sink Connector

MongoDB Kafka Connector

Mu (μ) is a purely functional framework for building micro services.

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

A library that makes it easier to use the Avro serialization format from Ruby.

Scala library to eliminate boilerplate

Avro SerDe for Apache Spark structured APIs.

Lego bricks to build Apache Kafka serializers and deserializers

A CLI and Go client for Kafka Schema Registry

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.