#
big-data
Here are 2,158 public repositories matching this topic...
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
computer-science
lists
devops
distributed-systems
machine-learning
awesome
web-development
programming
big-data
system
backend
architecture
scalability
resources
design-patterns
interview
awesome-list
interview-practice
interview-questions
system-design
-
Updated
Aug 28, 2020
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
python
aws
data-science
machine-learning
caffe
theano
big-data
spark
deep-learning
hadoop
tensorflow
numpy
scikit-learn
keras
pandas
kaggle
scipy
matplotlib
mapreduce
-
Updated
Jul 24, 2020 - Python
python
nlp
data-science
machine-learning
natural-language-processing
big-data
ai
deep-learning
neural-network
cython
artificial-intelligence
spacy
neural-networks
nlp-library
-
Updated
Aug 29, 2020 - Python
PredictionIO, a machine learning server for developers and ML engineers.
-
Updated
May 7, 2020 - Scala
An open source cybersecurity protocol for syncing decentralized graph data.
iot
machine-learning
cryptography
crypto
encryption
database
big-data
graph
offline-first
protocol
end-to-end
peer-to-peer
dapp
decentralized
blockchain
realtime
p2p
artificial-intelligence
crdt
dweb
-
Updated
Aug 26, 2020 - JavaScript
CMAK is a tool for managing Apache Kafka clusters
-
Updated
Aug 24, 2020 - Scala
scoder
commented
May 26, 2020
The latest copy of the CPython grammar tests in test_grammar.py has several @skips and FIXMEs. Some of them seem easy to fix, e.g. some parser bugs or missing warnings that would be helpful, others are entire features. We should fix the easy ones and make sure there are tickets for the rest.
gavrenkov
commented
Jun 17, 2020
Problem:
catboost version: 0.23.2
Operating System: all
Tutorial: https://github.com/catboost/tutorials/blob/master/custom_loss/custom_metric_tutorial.md
Impossible to use custom metric (С++).
Code example
from catboost import CatBoost
train_data = [[1, 4, 5, 6],
Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
python
java
data-science
machine-learning
multi-threading
opensource
r
big-data
spark
deep-learning
hadoop
random-forest
gpu
naive-bayes
h2o
distributed
pca
gbm
ensemble-learning
automl
-
Updated
Aug 29, 2020 - Jupyter Notebook
Apache CouchDB
javascript
couchdb
content
http
cloud
erlang
database
big-data
cplusplus
network-server
network-client
-
Updated
Aug 28, 2020 - Erlang
Reproducible Data Science at Scale!
go
docker
kubernetes
distributed-systems
data-science
big-data
analytics
containers
data-analysis
pachyderm
-
Updated
Aug 29, 2020 - Go
Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:
-
Updated
Aug 15, 2020 - Python
3
elfring
commented
Feb 17, 2020
Would you like to add more error handling for return values from functions like the following?
- malloc ⇒ moloch_trie_init
- [MOLOCH_LOCK_INIT](https://github.com/aol/moloch/blob/664ffe25810380f12823941c210
elR1co
commented
Aug 18, 2020
Today IMap.values() and IMap.values(Predicate) calls are blocking.
I would like to use IMap.values(Predicate) in a Jet Pipeline, which is possible, but I need to declare it as nonCooperative, and will have an impact on the pipeline scalability.
Would it be possible to have an async (non-blocking) version for these calls ?
Thank you very much for all the hard work done !
BigDL: Distributed Deep Learning Framework for Apache Spark
-
Updated
Aug 21, 2020 - Scala
Apache Ignite
iot
cloud
sql
database
big-data
hadoop
cache
osgi
ignite
network-server
in-memory-database
data-management-platform
network-client
distributed-sql-database
in-memory-computing
-
Updated
Aug 29, 2020 - Java
neuhausler
commented
Jun 9, 2020
PrestoDB https://prestodb.io .. is widely used as SQL frontend for many different data-sources, including ElasticSearch, and even files in S3 .. would be very nice if there would be a Connector available for Vespa.
An easy to use, self-service open BI reporting and BI dashboard platform.
-
Updated
Jun 16, 2020 - TSQL
Bare bone examples of machine learning in TensorFlow
big-data
simple
tensorflow
linear-regression
distributed-computing
tensorflow-tutorials
tensorflow-exercises
tensorflow-examples
-
Updated
Mar 14, 2017 - Python
Open
Series.reindex
19
ueshin
commented
Oct 3, 2019
Implement Series.reindex.
https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Series.reindex.html
Improve this page
Add a description, image, and links to the big-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the big-data topic, visit your repo's landing page and select "manage topics."
Now insert and query share the resource ( Max Process Count control) 。 When the query with high TPS，the insert will get error (“error: too many process”). I think separator the resource for Insert and Query will makes sense. Ensure enough resource for insert。It looks like Use Yarn， Insert and Query use the different resource quota。
Or the simple way , Can we set Ratio for Insert and