The Wayback Machine - http://web.archive.org/web/20210726074810/https://github.com/topics/spark
Skip to content
#

Apache Spark

Star
spark logo

Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.

Here are 5,819 public repositories matching this topic...

Language: All
Filter by language
All 5,819 Scala 1,613 Python 940 Java 878 Jupyter Notebook 828 Shell 251 HTML 167 JavaScript 142 Dockerfile 89 XSLT 55 R 49
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

donnemartin / data-science-ipython-notebooks

Star

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

python aws data-science machine-learning caffe theano big-data spark deep-learning hadoop tensorflow numpy scikit-learn keras pandas kaggle scipy matplotlib mapreduce
  • Updated May 13, 2021
  • Python
cube.js

cube-js / cube.js

Star
Open

dateRange 'Next 7 days'

2
chamabreu
chamabreu commented Jun 1, 2021

Describe the bug
If I pass 'Next 7 days' into the dateRange in query, the response is not a range over the next 7 days but only the day IN 7 days.

To Reproduce
Steps to reproduce the behavior:

  1. Build a query like this:
const query: Query = {
    measures: [
      measure
    ],
    timeDimensions: [
      {
        dimension: 'Your.Dimension,
        dateRange: 'Next 7
Read more
enhancement good first issue help wanted
Find more good first issues →
flink-learning

zhisheng17 / flink-learning

Star

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

mysql redis elasticsearch streaming kafka spark influxdb rabbitmq clickhouse hbase stream-processing opentsdb loki flink rocketmq
  • Updated Jun 24, 2021
  • Java

itdevbooks / pdf

Star

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

mysql python linux docker redis elasticsearch spark spring hadoop rabbitmq solr jvm netty springboot mybatis springcloud
  • Updated Jun 3, 2021

donnemartin / dev-setup

Star

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

nodejs mysql python git vim macos linux bash redis cli mac aws elasticsearch cloud spark mongodb iterm2 sublime-text postgresql android-development
  • Updated Dec 23, 2020
  • Python

h2oai / h2o-3

Star

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

python java data-science machine-learning multi-threading opensource r big-data spark deep-learning hadoop random-forest gpu naive-bayes h2o distributed pca gbm ensemble-learning automl
  • Updated Jul 26, 2021
  • Jupyter Notebook

delta-io / delta

Star
Open

NullPointerException when DeltaTable.create with Column with no DataType specified

5
jaceklaskowski
jaceklaskowski commented Jun 15, 2021
  • Delta Lake 1.0.0
  • Spark 3.1.2
  • Scala 2.12
  • AdoptOpenJDK-11.0.11+9 (build 11.0.11+9)

The following code gives a NullPointerException. This is for a directory-based delta table that does not exist and uses a generated column.

import io.delta.tables.DeltaTable
DeltaTable.create
  .addColumn(
    DeltaTable.columnBuilder("value")
      .generatedAlwaysAs("true")
      .nullab
Read more
bug good first issue

spark-jobserver / spark-jobserver

Star
Open

Can't get config, when I post a job with 'sync=true'

1
wanshicheng
wanshicheng commented Jun 23, 2021

Used Spark version
Spark Version: 2.4.4
Used Spark Job Server version
SJS version: v0.11.1

Deployed mode
client on Spark Standalone

Actual (wrong) behavior
I can't get config, when post a job with 'sync=true'. I got it：
http://localhost:8090/jobs/ff99479b-e59c-4215-b17d-4058f8d97d25/config
{"status":"ERROR","result":"No such job ID ff99479b-e59c-4215-b17d-4058f8d97d25"

Read more
bug good first issue
Find more good first issues →
mmlspark

Azure / mmlspark

Star
Open

[LightGBM] Regression: how to penalize negative predictions

3
brunocous
brunocous commented Sep 2, 2020

I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?

Read more
LightGBM enhancement good first issue
Find more good first issues →

Created by Matei Zaharia

Released May 26, 2014

Repository
apache/spark
Website
spark.apache.org
Wikipedia
Wikipedia

Related Topics

hadoop scala