Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Jupyter magics and kernels for working with remote Spark clusters

R interface for Apache Spark

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Mirror of Apache livy (Incubating)

A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator

Spark on Kubernetes infrastructure Helm charts repo

Spark on Kubernetes infrastructure Docker images repo

Experiments produced during an end of studies project (ETS, H2018)

Livy Manager - Web UI for Managing Apache Livy Sessions

Mirror of Apache livy (Incubating)

C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

Experiment to get LIVY+ Apache Spark working on DC/OS + MESOS + Docker

hdsf, hadoop & spark dockers for study

This tests Apache Knox proxying to Apache Livy

An Airflow plugin which supply some AWS operators with extended feature over the build in Airflow's operators

Apache Livy REST API Client

Apache Livy server for Docker

This is a web-based movie recommendation application written in Scala using Apache Spark and Livy.

.net wrapper for Livy

HDInsight provider for Airflow

Apache Livy client for the Go programming language.

Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.

Go API client for Apache Livy | Work in progress

An airflow DAG transformation framework

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

Run a job in Spark 2.x with HDInsight and submit the job through Livy

Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.

Jupyter magics and kernels for working with remote Spark clusters