Build software better, together

chrislusf / seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV, mount cloud storage.

kubernetes distributed-systems fuse replication s3 posix s3-storage hdfs distributed-storage distributed-file-system erasure-coding object-storage blob-storage seaweedfs hadoop-hdfs tiered-file-system

Updated Aug 15, 2021
Go

truenas / middleware

Star

TrueNAS CORE/Enterprise/SCALE Middleware Git Repository

scale storage smb nfs s3-storage iscsi zfs freenas truenas

Updated Aug 15, 2021
Python

leo-project / leofs

Star

The LeoFS Storage System

erlang s3 nfs s3-storage distributed-storage distributed-file-system leofs nfs-server datalake

Updated Jun 2, 2020
Erlang

scality / cloudserver

Star

Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.

nodejs javascript docker cloud storage aws-s3 cloud-storage s3-storage cloud-native object-storage multiple-backends

Updated Aug 14, 2021
JavaScript

TileDB-Inc / TileDB

Star

The Universal Storage Engine

data-science storage-engine s3 sparse-data scientific-computing s3-storage arrays hdfs data-analysis dataframes tiledb dense-data sparse-arrays

Updated Aug 13, 2021
C++

stavro / arc

Star

📎 Flexible file upload and attachment library for Elixir

elixir storage s3 attachment s3-storage

Updated Nov 26, 2019
Elixir

stefanprodan / mgob

Star

MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

docker kubernetes backup mongodb sftp s3-storage

Updated Jun 24, 2021
Go

Seagate / cortx

Star

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

open-source inclusivity distributed-systems opensource big-data storage bigdata s3 hackathons s3-storage objectstore distributed-storage software-defined-storage objectstorage hacktoberfest storage-api object-storage hacktoberfest2020 object-storage-service cortx-community

Updated Aug 14, 2021
Jupyter Notebook

open-io / oio-sds

Star

High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

python c lightweight golang open-source flexible storage openstack-swift s3-storage software-defined-storage objectstorage object-storage

Updated Aug 13, 2021
Python

MikaAK / s3-plugin-webpack

Star

Uploads files to s3 after complete

webpack amazon s3-storage

Updated Aug 12, 2021
JavaScript

Clivern / Walrus

Sponsor Star

🔥 Fast, Secure and Reliable System Backup, Set up in Minutes.

backup walrus s3 minio s3-storage recovery high-availability digitalocean-spaces clivern minio-storage

Updated Aug 15, 2021
Go

awslabs / serverless-photo-recognition

Star

A collection of 3 lambda functions that are invoked by Amazon S3 or Amazon API Gateway to analyze uploaded images with Amazon Rekognition and save picture labels to ElasticSearch (written in Kotlin)