hdfs repositories

Trending repositories tagged hdfs, ranked by trending score. Updated daily.

  1. 1
    seaweedfs/seaweedfs

    SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

    GitHub · Go · 36,161 stars · 3,130 forks · +27 stars in 24 hours · Trending score 2.98

  2. 2
    juicedata/juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    GitHub · Go · 14,762 stars · 1,364 forks · +14 stars in 24 hours · Trending score 2.40

  3. 3
    ceph/ceph

    Ceph is a distributed object, block, and file storage platform

    GitHub · C++ · 17,249 stars · 6,577 forks · +9 stars in 24 hours · Trending score 2.15

  4. 4
    wgzhao/Addax

    Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.

    GitHub · Java · 1,454 stars · 342 forks · −2 stars in 24 hours · Trending score 0.37

  5. 5
    RumbleDB/rumble

    Quick start: pip install jsoniq ⛈️ RumbleDB 3.1.0 "Pistachio Tree" 🌳 | Run queries on your large-scale, messy datasets (JSON, text, CSV, XML, YAML, Parquet, Delta...) | Data Lakehouse with Updates, Scripting, Declarative Machine Learning

    GitHub · Java · 251 stars · 87 forks · 0 stars in 24 hours · Trending score 0.33

  6. 6
    starlake-ai/starflow

    Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

    GitHub · Scala · 219 stars · 29 forks · 0 stars in 24 hours · Trending score 0.32

  7. 7
    TencentBlueKing/blueking-dbm

    DBM,数据库管理,集成了MySQL、Redis、ES、Kafka、HDFS、InfluxDB、Pulsar等多种数据库组件的全生命周期管理,提供了海量集群的批量管理能力,以及相应DB组件的集群管理工具箱,并配套DB个性化配置、高可用切换、域名管理等DB个性化服务,同时全方位的监控告警可观测能力,让数据库管理员、运维、开发等用户可以轻松完成数据库管理工作,更高效、更安全、更全面的管理数据库。 The database management platform integrates a variety of database components such as MySQL...

    GitHub · Python · 124 stars · 97 forks · 0 stars in 24 hours · Trending score 0.19

  8. 8
    terascope/teraslice

    Scalable data processing pipelines in JavaScript

    GitHub · TypeScript · 60 stars · 15 forks · 0 stars in 24 hours · Trending score 0.19

  9. 9
    fluent/fluent-plugin-webhdfs

    Hadoop WebHDFS output plugin for Fluentd

    GitHub · Ruby · 60 stars · 37 forks · 0 stars in 24 hours · Trending score 0.17

  10. 10
    stackabletech/hdfs-operator

    Kubernetes operator for Apache Hadoop HDFS. Deploy and run HDFS NameNodes, DataNodes and JournalNodes with the Stackable Data Platform (SDP).

    GitHub · Rust · 53 stars · 10 forks · 0 stars in 24 hours · Trending score 0.10

  11. 11
    juliopez/Hadoop

    Big Data infrastructure with Hadoop, Spark, Hive and NiFi deployed using Docker Compose. https://doi.org/10.5281/zenodo.18968438

    GitHub · HTML · 33 stars · 16 forks · 0 stars in 24 hours · Trending score 0.08

  12. 12
    marcelmay/hfsa

    Hadoop FSImage Analyzer (HFSA)

    GitHub · Java · 69 stars · 27 forks · 0 stars in 24 hours · Trending score 0.08

  13. 13
    marcelmay/hadoop-hdfs-fsimage-exporter

    Exports Hadoop HDFS content statistics to Prometheus

    GitHub · Java · 162 stars · 49 forks · 0 stars in 24 hours · Trending score 0.08

  14. 14
    breuner/elbencho

    A distributed storage benchmark for file systems, object stores & block devices with support for GPUs

    GitHub · C++ · 300 stars · 49 forks · 0 stars in 24 hours · Trending score 0.02

  15. 15
    piskvorky/smart_open

    Utils for streaming large files (S3, HDFS, gzip, bz2...)

    GitHub · Python · 3,468 stars · 403 forks · 0 stars in 24 hours · Trending score 0.00