big-data
Here are 2,196 public repositories matching this topic...
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
-
Updated
Sep 21, 2020
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
-
Updated
Jul 24, 2020 - Python
-
Updated
Sep 30, 2020 - Python
PredictionIO, a machine learning server for developers and ML engineers.
-
Updated
Sep 13, 2020 - Scala
An open source cybersecurity protocol for syncing decentralized graph data.
-
Updated
Sep 29, 2020 - JavaScript
CMAK is a tool for managing Apache Kafka clusters
-
Updated
Sep 9, 2020 - Scala
The latest copy of the CPython grammar tests in test_grammar.py has several @skips and FIXMEs. Some of them seem easy to fix, e.g. some parser bugs or missing warnings that would be helpful, others are entire features. We should fix the easy ones and make sure there are tickets for the rest.
Problem:
catboost version: 0.23.2
Operating System: all
Tutorial: https://github.com/catboost/tutorials/blob/master/custom_loss/custom_metric_tutorial.md
Impossible to use custom metric (С++).
Code example
from catboost import CatBoost
train_data = [[1, 4, 5, 6],
Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
-
Updated
Sep 30, 2020 - Jupyter Notebook
Seamless multi-master syncing database with an intuitive HTTP/JSON API, designed for reliability
-
Updated
Sep 30, 2020 - Erlang
Reproducible Data Science at Scale!
-
Updated
Sep 30, 2020 - Go
Hello. I would like to ask for suggestions for additional features for development.
On the Sessions tab,
Please develop a function that can addon to frequently used search queries.
Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:
-
Updated
Sep 1, 2020 - Python
In some cases, the default implementations are very inefficient (e.g. Map.replaceAll and forEach fetching all entries and iterating over them locally). This was improved on member-side as the cluster version is available and in some cases we opted for using entry processors instead.
On the client-side, the cluster version is not available which meant it ends up still using the default versi
BigDL: Distributed Deep Learning Framework for Apache Spark
-
Updated
Sep 28, 2020 - Scala
Apache Ignite
-
Updated
Sep 30, 2020 - Java
PrestoDB https://prestodb.io .. is widely used as SQL frontend for many different data-sources, including ElasticSearch, and even files in S3 .. would be very nice if there would be a Connector available for Vespa.
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
An easy to use, self-service open BI reporting and BI dashboard platform.
-
Updated
Jun 16, 2020 - TSQL
Bare bone examples of machine learning in TensorFlow
-
Updated
Mar 14, 2017 - Python
Improve this page
Add a description, image, and links to the big-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the big-data topic, visit your repo's landing page and select "manage topics."



Now insert and query share the resource ( Max Process Count control) 。 When the query with high TPS,the insert will get error (“error: too many process”). I think separator the resource for Insert and Query will makes sense. Ensure enough resource for insert。It looks like Use Yarn, Insert and Query use the different resource quota。
Or the simple way , Can we set Ratio for Insert and