As a Data Engineer for a fictional E-commerce startup, this project addresses the task of analyzing the web server logs to find the number of product pages visited and the number of items in the cart.

airflow real-time kafka spark-streaming data-pipeline data-engineer

Updated Mar 28, 2021
HTML

swilliamc / SparkSQL

Star

UC Davis Distributed Computing with Spark SQL (with Databricks) and Databricks Apache Spark SQL for Data Analysts

machine-learning sql spark apache-spark linear-regression distributed-computing sparksql logistic-regression data-pipeline engineering-data python-sklearn

Updated Jul 10, 2021
HTML

demand-consults / demand_acep

Star

A data-pipeline for high-resolution power meter data

data-science data-pipeline power-meter-data

Updated Aug 10, 2021
HTML

anchitagarwal / decoding-stackoverflow

Star

Bringing you the posts that matter.

flask aws scala database kafka spark mongodb aws-s3 stackoverflow postgresql aws-ec2 batch-processing data-pipeline

Updated Feb 2, 2018
HTML

latuyetmai / mla-folio

Star

machine-learning oop data-analysis hypothesis-testing causal-inference data-pipeline data-parsing statistical-regression

Updated Sep 16, 2021
HTML

chintanp / demand_acep

Star

A data-pipeline for high-resolution power meter data

python data-science data-pipeline power-meter-data

Updated Jul 3, 2019
HTML

Improve this page

Add a description, image, and links to the data-pipeline topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-pipeline topic, visit your repo's landing page and select "manage topics."

Learn more

Sep	OCT	Nov
	17
2020	2021	2022