The Data Engineering subteam of Cornell Data Science

Graphical recommender system in Scala using personalized PageRank

This application will calculate the daily product revenue that displays date in ascending order and revenue in decending order in Spark & MySQL. It also demonstrates how to reduce Stages & Task in Spark using broadcast variables.

Twitter Sentiment Analysis using Kafka Connect, Spark Streaming, Apache Avro, MLlib and Stanford CoreNLP

Exploratory Data Analysis with Spark on Anime Data & User data provided by MyAnimelist

基于SparkMllib的电影推荐系统

Predicting Average Adjusted Gross Income (AGI) per County in the USA with Linear Regression (Spark MLIB) using US Census data and IRS Tax Info.

Scala and spark utility

Spark DStream application to detect emerging topics on Twitter

Predicting the fare of Taxi rides (with Spark-Scala)

This is Spark/Scala based Next Best Offer Recommendation Model which used Random Forest Classifier Algorithm

This is Spark/Scala based Mobile Telecommunication Customer Value Added Services Recommendation Model which used Collaborative Filtering based Alternative Least Square Algorithm.

This is spark/Scala based Mobile Telecommunication Customer Churn Prediction model developed using Random Forest algorithm

MovieLens datasets processing using spark-scala Core and SQL APIs

Developed a machine learning pipeline to pull articles from the New York Times API and classify them as one of 4 catergories. Implemented with mySQL, python, and Spark w/ Scala

[Scala] ELB Log Analysis and Prediction using Spark.

spark scala example

Data processing of the social network StackOverflow using Spark.

Data Pre-processing with Spark using Scala

Assignments in R programming (data analysis, clustering) and Spark within Big Data Programming course in my master's program.

Implement Word Count project using Scala and Build by SBT

KMeans implementation in SCALA using Breeze.

Testing Spark Mllib k-Means

Big Data Analysis assignments with Scala and Spark by École Polytechnique Fédérale de Lausanne

Testing Spark Mllib SVM

ConversationUI