Apache Spark - A unified analytics engine for large-scale data processing

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

💫 Industrial-strength Natural Language Processing (NLP) with Python and Cython

Apache Flink

PredictionIO, a machine learning server for developers and ML engineers.

An open source cybersecurity protocol for syncing decentralized graph data.

ClickHouse is a free analytics DBMS for big data

The official home of the Presto distributed SQL query engine for big data

CMAK is a tool for managing Apache Kafka clusters

大数据入门指南 ⭐

Mirror of Apache Storm

The most widely used Python to C compiler

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Apache CouchDB

Reproducible Data Science at Scale!

Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:

Moloch is an open source, large scale, full packet capturing, indexing, and database system.

Apache Beam is a unified programming model for Batch and Streaming

Open Source In-Memory Data Grid

BigDL: Distributed Deep Learning Framework for Apache Spark

Apache Ignite

Apache Hive

Vespa is an engine for low-latency computation over large data sets.

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

An easy to use, self-service open BI reporting and BI dashboard platform.

Bare bone examples of machine learning in TensorFlow

Koalas: pandas API on Apache Spark