avro
Here are 461 public repositories matching this topic...
Record Query - A tool for doing record analysis and transformation
-
Updated
Jun 23, 2020 - Rust
Apache Kafka and Confluent Platform examples and demos
-
Updated
Dec 3, 2020 - Shell
Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
-
Updated
Jan 24, 2017 - Scala
Avro schema generation and serialization / deserialization for Scala
-
Updated
Dec 2, 2020 - Scala
Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++
-
Updated
Jan 28, 2020 - C++
Currently, there isn't a way to get the table properties in the SparkOrcWriter via the WriterFactory.
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
-
Updated
Nov 23, 2020 - Python
Over time we've had some things leak into the diff methods that make it more cumbersome to use BigDiffy via code instead of CLI.
For example diffAvro here https://github.com/spotify/ratatool/blob/master/ratatool-diffy/src/main/scala/com/spotify/ratatool/diffy/BigDiffy.scala#L284
User has to manually pass in schema otherwise we they receive a non-informative error regarding null schema, add
Divolte Collector
-
Updated
Dec 3, 2020 - Java
Migrate to goavro v2
Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile
-
Updated
Dec 1, 2020 - Java
If I execute nix-shell python-test.nix, I am welcomed with the following message:
error: expression does not evaluate to a derivation (or a set or list of those)
This is not great, because we cannot check for inconsistencies with the official implementations of Avro and Protocol Buffers.
It would be great too if this could be integrated as part of CI (it was at some point, but
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
-
Updated
Feb 1, 2019 - TypeScript
A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
-
Updated
Dec 2, 2020 - Java
MongoDB Kafka Connector
-
Updated
Nov 24, 2020 - Java
-
Updated
Oct 9, 2020 - Python
**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
-
Updated
Oct 29, 2020 - Java
Avro SerDe for Apache Spark structured APIs.
-
Updated
Nov 18, 2020 - Scala
If you tag a type that has a Numeric or Ordering your tagged type no is an instance of these typeclasses. Example solution for Numeric:
implicit def taggedNumeric[A: Numeric, Tag]: Numeric[A @@ Tag] = new Numeric[A @@ Tag] {
override def plus(x: A @@ Tag, y: A @@ Tag): A @@ Tag = implicitly[Numeric[A]].plus(x, y).taggedWith[Tag]
override def minus(x: A @@ Tag, y: A @@ T
Improve docs
A library that makes it easier to use the Avro serialization format from Ruby.
-
Updated
Nov 24, 2020 - Ruby
Lego bricks to build Apache Kafka serializers and deserializers
-
Updated
Nov 11, 2020 - Scala
Improve this page
Add a description, image, and links to the avro topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the avro topic, visit your repo's landing page and select "manage topics."


The title might seem a bit vague but I don't know how to describe it any better tbh :-)
Anyway this is what happened: I got some 500 responses from the schema registry and all I could see in the logs was :
The logs di