parquet repositories

Trending repositories tagged parquet, ranked by trending score. Updated daily.

  1. 1
    datazip-inc/olake-go

    OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

    GitHub · Go · 2,062 stars · 314 forks · +196 stars in 24 hours · Trending score 4.21

  2. 2
    apache/arrow

    Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

    GitHub · C++ · 17,317 stars · 4,469 forks · +7 stars in 24 hours · Trending score 2.07

  3. 3
    labstack/pitot

    Single-binary observability platform. Ingest OTLP, store as Parquet, query with DuckDB.

    GitHub · Go · 148 stars · 3 forks · +9 stars in 24 hours · Trending score 2.03

  4. 4
    apache/arrow-rs

    Official Rust implementation of Apache Arrow

    GitHub · Rust · 3,675 stars · 1,452 forks · +5 stars in 24 hours · Trending score 1.79

  5. 5
    rilldata/rill

    The fastest business intelligence tool for humans and agents.

    GitHub · Go · 3,006 stars · 208 forks · +6 stars in 24 hours · Trending score 1.60

  6. 6
    rootSunc/CNEquity

    开源中国股市(A股)本地数据湖:沪深股票行情、A股股票数据与金融数据,面向量化研究、量化交易与回测,含财务数据、期货数据、资金流向、公告、指数行业与宏观。86个日更数据集,复权与历史成分内置,行级溯源、PIT,MCP原生。免注册、免 Token,自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.

    GitHub · Python · 1,028 stars · 114 forks · 0 stars in 24 hours · Trending score 1.51

  7. 7
    questdb/questdb

    QuestDB is a high performance, open-source, time-series database

    GitHub · Java · 17,540 stars · 1,704 forks · +1 stars in 24 hours · Trending score 1.34

  8. 8
    davanstrien/saturate

    Batch inference for datasets: rows in, any OpenAI-compatible endpoint, resumable parquet out. Congestion-aware concurrency — no tuning.

    GitHub · Python · 56 stars · 2 forks · +2 stars in 24 hours · Trending score 1.22

  9. 9
    yakisoba0728/vrfkit

    VALORANT replay (.vrf) parser and analysis toolkit — lossless, every value exported. Rust.

    GitHub · Rust · 31 stars · 14 forks · +2 stars in 24 hours · Trending score 1.18

  10. 10
    jlruedab/clifr

    clifr is a Linux System Flight Recorder (SFR) that continuously captures processes, connections, open files and system counters, then shows accurate ps, ss, lsof, top (and 30+ other) tools' full-output for any past moment; tamper-proof and with very low-overhead.

    GitHub · Go · 15 stars · 1 forks · +8 stars in 24 hours · Trending score 1.15

  11. 11
    parquet-go/parquet-go

    High-performance Go package to read and write Parquet files

    GitHub · Go · 800 stars · 162 forks · +1 stars in 24 hours · Trending score 1.14

  12. 12
    sebastienrousseau/bankstatementparser

    Parse bank statements (CAMT, PAIN.001, MT940, MT942, OFX/QFX, BAI2, CSV, and PDF) into unified Transactions. Treasury analytics, 2-way reconciliation, PDF forensics, Parquet & Ledger exports (hledger, beancount), deduplication, LLM & vision fallback, CLI, and REST API. 🐍

    GitHub · Python · 64 stars · 14 forks · +3 stars in 24 hours · Trending score 1.09

  13. 13
    mordechaipotash/brain-mcp

    The recorder for your AI conversations — local-first MCP memory that keeps byte-exact copies of your Claude Code, Codex and Pi sessions (Claude Code deletes its own after 30 days) and answers with a citation or abstains. DuckDB.

    GitHub · Python · 82 stars · 17 forks · +4 stars in 24 hours · Trending score 1.05

  14. 14
    Kuinox/Plank

    High-performance Parquet reader and writer for .NET

    GitHub · C# · 26 stars · 3 forks · +1 stars in 24 hours · Trending score 1.00

  15. 15
    ClickHouse/ClickBench

    ClickBench: a Benchmark For Analytical Databases

    GitHub · Shell · 1,170 stars · 338 forks · +1 stars in 24 hours · Trending score 0.99

  16. 16
    hardwood-hq/hardwood

    A fast minimal dependency implementation of Apache Parquet

    GitHub · Java · 425 stars · 102 forks · +1 stars in 24 hours · Trending score 0.95

  17. 17
    parseablehq/parseable

    Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.

    GitHub · Rust · 2,581 stars · 185 forks · +1 stars in 24 hours · Trending score 0.94

  18. 18
    nao1215/filesql

    loads CSV, TSV, LTSV, JSON, JSONL, Parquet, XLSX, ACH, and Fedwire files into SQLite; includes prep and frame for cleanup and in-memory transforms

    GitHub · Go · 388 stars · 12 forks · +1 stars in 24 hours · Trending score 0.82

  19. 19
    CrunchyData/pg_parquet

    Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

    GitHub · Rust · 697 stars · 40 forks · +2 stars in 24 hours · Trending score 0.81

  20. 20
    nisshi-io/solace-nisshi

    Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

    GitHub · Rust · 1,934 stars · 87 forks · +1 stars in 24 hours · Trending score 0.80

  21. 21
    ReliablyObserve/victoria-lakehouse

    S3-backed cold storage for VictoriaLogs and VictoriaTraces — 60-96% cost reduction with unlimited retention, disaster recovery, and open Parquet format for analytics.

    GitHub · Go · 9 stars · 2 forks · +1 stars in 24 hours · Trending score 0.79

  22. 22
    parqdb-io/parqdb

    Billion-scale embedded vector database built entirely on Parquet and Arrow.

    GitHub · Python · 117 stars · 10 forks · 0 stars in 24 hours · Trending score 0.69

  23. 23
    lakehq/sail

    Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

    GitHub · Rust · 3,504 stars · 243 forks · 0 stars in 24 hours · Trending score 0.69

  24. 24
    nao1215/sqly

    executes SQL against CSV, TSV, LTSV, JSON, JSONL, Parquet, Microsoft Excel™ , ACH, and Fedwire files with shell.

    GitHub · Go · 197 stars · 3 forks · +1 stars in 24 hours · Trending score 0.69