big-data
Here are 2,188 public repositories matching this topic...
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
-
Updated
Sep 18, 2020
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
-
Updated
Jul 24, 2020 - Python
-
Updated
Sep 20, 2020 - Python
PredictionIO, a machine learning server for developers and ML engineers.
-
Updated
Sep 13, 2020 - Scala
An open source cybersecurity protocol for syncing decentralized graph data.
-
Updated
Sep 20, 2020 - JavaScript
CMAK is a tool for managing Apache Kafka clusters
-
Updated
Sep 9, 2020 - Scala
Something that could help the documentation would be a glossary that certain terms could link to. A pointer would be a good candidate, or C data structures (struct/union) in general. Also extension type, terms like extern or inline, etc. It wouldn't have to replicate a complete specification o
Problem:
catboost version: 0.23.2
Operating System: all
Tutorial: https://github.com/catboost/tutorials/blob/master/custom_loss/custom_metric_tutorial.md
Impossible to use custom metric (С++).
Code example
from catboost import CatBoost
train_data = [[1, 4, 5, 6],
Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
-
Updated
Sep 20, 2020 - Jupyter Notebook
Seamless multi-master syncing database with an intuitive HTTP/JSON API, designed for reliability
-
Updated
Sep 18, 2020 - Erlang
Reproducible Data Science at Scale!
-
Updated
Sep 18, 2020 - Go
Hello. I would like to ask for suggestions for additional features for development.
On the Sessions tab,
Please develop a function that can addon to frequently used search queries.
Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:
-
Updated
Sep 1, 2020 - Python
Today IMap.values() and IMap.values(Predicate) calls are blocking.
I would like to use IMap.values(Predicate) in a Jet Pipeline, which is possible, but I need to declare it as nonCooperative, and will have an impact on the pipeline scalability.
Would it be possible to have an async (non-blocking) version for these calls ?
Thank you very much for all the hard work done !
BigDL: Distributed Deep Learning Framework for Apache Spark
-
Updated
Sep 18, 2020 - Scala
Apache Ignite
-
Updated
Sep 20, 2020 - Java
PrestoDB https://prestodb.io .. is widely used as SQL frontend for many different data-sources, including ElasticSearch, and even files in S3 .. would be very nice if there would be a Connector available for Vespa.
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
An easy to use, self-service open BI reporting and BI dashboard platform.
-
Updated
Jun 16, 2020 - TSQL
Bare bone examples of machine learning in TensorFlow
-
Updated
Mar 14, 2017 - Python
Improve this page
Add a description, image, and links to the big-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the big-data topic, visit your repo's landing page and select "manage topics."



Now insert and query share the resource ( Max Process Count control) 。 When the query with high TPS,the insert will get error (“error: too many process”). I think separator the resource for Insert and Query will makes sense. Ensure enough resource for insert。It looks like Use Yarn, Insert and Query use the different resource quota。
Or the simple way , Can we set Ratio for Insert and