A curated list of awesome big data frameworks, ressources and other awesomeness.
-
Updated
Aug 24, 2020
{{ message }}
A curated list of awesome big data frameworks, ressources and other awesomeness.
flink learning blog. http://www.flink-learning.com 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Python Stream Processing
Running : CLI v0.11.0, Server v0.11.0
(pulled from confluentinc/ksqldb-server:0.11.0)
Creating a stream with a field named "size" results in the following error :
extraneous input 'size' expecting {'EMIT'
It seems like size is considered a reserved keyword.
Creating the stream with CREATE STREAM trades ( "size" DOUBLE ) works.
Looks similar to https://github.com/confluentinc/ksql/issu
A curated list of awesome System Design (A.K.A. Distributed Computing) resources.
A stream processor for mundane tasks written in Go
High-performance time-series aggregation for PostgreSQL
Fast and Lightweight Log processor and forwarder for Linux, BSD and OSX
Currently, you are not able to use middleware per handler in "clean way" (you can still manually wrap the handler function, or have separated router).
It would be nice to be able to add middleware per handler.
As a good reference point, you can use chi router: https://github.com/go-chi/chi
fastest JSON encoder/decoder with powerful stream API for Golang
a curated list of awesome streaming frameworks, applications, etc
A Python stream processing engine modeled after Yahoo! Pipes
It can be very difficult to piece together a reasonably estimate of a history of events from the current workers logs because none of them have timestamps.
So for that end, I think we should add timestamps to the logs.
This has some cons:
@printf like we have been until now. We need to either include a timestamp in every @printf call (laborious and error prone) or cUpserts, Deletes And Incremental Processing on Big Data.
Stream Processing and Complex Event Processing Engine
Wormhole is a SPaaS (Stream Processing as a Service) Platform
For example, given a simple pipeline such as:
Pipeline p = Pipeline.create();
p.readFrom(TestSources.items("the", "quick", "brown", "fox"))
.aggregate(aggregator)
.writeTo(Sinks.logger());
I'd like aggregator to be something requiring a non-serialisable dependency to do its work.
I know I can do this:
Pipeline p = Pipeline.create();
p.readFrom(TestSource
Lightweight real-time big data streaming engine over Akka
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Framework for building Event-Driven Microservices
A stream processing API for Go (alpha)
equivalent to kafka-streams
Streaming System 相关的论文读物
Kasper is a lightweight library for processing Kafka topics.
Go stream processing library
A list about Apache Kafka
All exceptions in namespace JsonMachine\Exception should extend one common exception, say JsonMachineException, so that userland code can catch for only one type and catch anything from this library. Fell free to create pull request and participate :)
Add a description, image, and links to the stream-processing topic page so that developers can more easily learn about it.
To associate your repository with the stream-processing topic, visit your repo's landing page and select "manage topics."
Hello, dear Mediapipe guys.
I want to inference the hand pose with Mediapipe model and my own model.
I have my own tf-lite models, it can work on the RGB bitmap.
I try to query the RGB bitmap from input frame with data packet.
My code is