hdfs repositories
Trending repositories tagged hdfs, ranked by trending score. Updated daily.
-
1
seaweedfs/seaweedfs
SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
GitHub · Go · 36,161 stars · 3,130 forks · +27 stars in 24 hours · Trending score 2.98
-
2
juicedata/juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
GitHub · Go · 14,762 stars · 1,364 forks · +14 stars in 24 hours · Trending score 2.40
-
3
ceph/ceph
Ceph is a distributed object, block, and file storage platform
GitHub · C++ · 17,249 stars · 6,577 forks · +9 stars in 24 hours · Trending score 2.15
-
4
wgzhao/Addax
Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
GitHub · Java · 1,454 stars · 342 forks · −2 stars in 24 hours · Trending score 0.37
-
5
RumbleDB/rumble
Quick start: pip install jsoniq ⛈️ RumbleDB 3.1.0 "Pistachio Tree" 🌳 | Run queries on your large-scale, messy datasets (JSON, text, CSV, XML, YAML, Parquet, Delta...) | Data Lakehouse with Updates, Scripting, Declarative Machine Learning
GitHub · Java · 251 stars · 87 forks · 0 stars in 24 hours · Trending score 0.33
-
6
starlake-ai/starflow
Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
GitHub · Scala · 219 stars · 29 forks · 0 stars in 24 hours · Trending score 0.32
-
7
TencentBlueKing/blueking-dbm
DBM,数据库管理,集成了MySQL、Redis、ES、Kafka、HDFS、InfluxDB、Pulsar等多种数据库组件的全生命周期管理,提供了海量集群的批量管理能力,以及相应DB组件的集群管理工具箱,并配套DB个性化配置、高可用切换、域名管理等DB个性化服务,同时全方位的监控告警可观测能力,让数据库管理员、运维、开发等用户可以轻松完成数据库管理工作,更高效、更安全、更全面的管理数据库。 The database management platform integrates a variety of database components such as MySQL...
GitHub · Python · 124 stars · 97 forks · 0 stars in 24 hours · Trending score 0.19
-
8
terascope/teraslice
Scalable data processing pipelines in JavaScript
GitHub · TypeScript · 60 stars · 15 forks · 0 stars in 24 hours · Trending score 0.19
-
9
fluent/fluent-plugin-webhdfs
Hadoop WebHDFS output plugin for Fluentd
GitHub · Ruby · 60 stars · 37 forks · 0 stars in 24 hours · Trending score 0.17
-
10
stackabletech/hdfs-operator
Kubernetes operator for Apache Hadoop HDFS. Deploy and run HDFS NameNodes, DataNodes and JournalNodes with the Stackable Data Platform (SDP).
GitHub · Rust · 53 stars · 10 forks · 0 stars in 24 hours · Trending score 0.10
-
11
juliopez/Hadoop
Big Data infrastructure with Hadoop, Spark, Hive and NiFi deployed using Docker Compose. https://doi.org/10.5281/zenodo.18968438
GitHub · HTML · 33 stars · 16 forks · 0 stars in 24 hours · Trending score 0.08
-
12
marcelmay/hfsa
Hadoop FSImage Analyzer (HFSA)
GitHub · Java · 69 stars · 27 forks · 0 stars in 24 hours · Trending score 0.08
-
13
marcelmay/hadoop-hdfs-fsimage-exporter
Exports Hadoop HDFS content statistics to Prometheus
GitHub · Java · 162 stars · 49 forks · 0 stars in 24 hours · Trending score 0.08
-
14
breuner/elbencho
A distributed storage benchmark for file systems, object stores & block devices with support for GPUs
GitHub · C++ · 300 stars · 49 forks · 0 stars in 24 hours · Trending score 0.02
-
15
piskvorky/smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
GitHub · Python · 3,468 stars · 403 forks · 0 stars in 24 hours · Trending score 0.00