parquet repositories
Trending repositories tagged parquet, ranked by trending score. Updated daily.
-
1
datazip-inc/olake-go
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
GitHub · Go · 2,062 stars · 314 forks · +196 stars in 24 hours · Trending score 4.21
-
2
apache/arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
GitHub · C++ · 17,317 stars · 4,469 forks · +7 stars in 24 hours · Trending score 2.07
-
3
labstack/pitot
Single-binary observability platform. Ingest OTLP, store as Parquet, query with DuckDB.
GitHub · Go · 148 stars · 3 forks · +9 stars in 24 hours · Trending score 2.03
-
4
apache/arrow-rs
Official Rust implementation of Apache Arrow
GitHub · Rust · 3,675 stars · 1,452 forks · +5 stars in 24 hours · Trending score 1.79
-
5
rilldata/rill
The fastest business intelligence tool for humans and agents.
GitHub · Go · 3,006 stars · 208 forks · +6 stars in 24 hours · Trending score 1.60
-
6
rootSunc/CNEquity
开源中国股市(A股)本地数据湖:沪深股票行情、A股股票数据与金融数据,面向量化研究、量化交易与回测,含财务数据、期货数据、资金流向、公告、指数行业与宏观。86个日更数据集,复权与历史成分内置,行级溯源、PIT,MCP原生。免注册、免 Token,自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.
GitHub · Python · 1,028 stars · 114 forks · 0 stars in 24 hours · Trending score 1.51
-
7
questdb/questdb
QuestDB is a high performance, open-source, time-series database
GitHub · Java · 17,540 stars · 1,704 forks · +1 stars in 24 hours · Trending score 1.34
-
8
davanstrien/saturate
Batch inference for datasets: rows in, any OpenAI-compatible endpoint, resumable parquet out. Congestion-aware concurrency — no tuning.
GitHub · Python · 56 stars · 2 forks · +2 stars in 24 hours · Trending score 1.22
-
9
yakisoba0728/vrfkit
VALORANT replay (.vrf) parser and analysis toolkit — lossless, every value exported. Rust.
GitHub · Rust · 31 stars · 14 forks · +2 stars in 24 hours · Trending score 1.18
-
10
jlruedab/clifr
clifr is a Linux System Flight Recorder (SFR) that continuously captures processes, connections, open files and system counters, then shows accurate ps, ss, lsof, top (and 30+ other) tools' full-output for any past moment; tamper-proof and with very low-overhead.
GitHub · Go · 15 stars · 1 forks · +8 stars in 24 hours · Trending score 1.15
-
11
parquet-go/parquet-go
High-performance Go package to read and write Parquet files
GitHub · Go · 800 stars · 162 forks · +1 stars in 24 hours · Trending score 1.14
-
12
sebastienrousseau/bankstatementparser
Parse bank statements (CAMT, PAIN.001, MT940, MT942, OFX/QFX, BAI2, CSV, and PDF) into unified Transactions. Treasury analytics, 2-way reconciliation, PDF forensics, Parquet & Ledger exports (hledger, beancount), deduplication, LLM & vision fallback, CLI, and REST API. 🐍
GitHub · Python · 64 stars · 14 forks · +3 stars in 24 hours · Trending score 1.09
-
13
mordechaipotash/brain-mcp
The recorder for your AI conversations — local-first MCP memory that keeps byte-exact copies of your Claude Code, Codex and Pi sessions (Claude Code deletes its own after 30 days) and answers with a citation or abstains. DuckDB.
GitHub · Python · 82 stars · 17 forks · +4 stars in 24 hours · Trending score 1.05
-
14
Kuinox/Plank
High-performance Parquet reader and writer for .NET
GitHub · C# · 26 stars · 3 forks · +1 stars in 24 hours · Trending score 1.00
-
15
ClickHouse/ClickBench
ClickBench: a Benchmark For Analytical Databases
GitHub · Shell · 1,170 stars · 338 forks · +1 stars in 24 hours · Trending score 0.99
-
16
hardwood-hq/hardwood
A fast minimal dependency implementation of Apache Parquet
GitHub · Java · 425 stars · 102 forks · +1 stars in 24 hours · Trending score 0.95
-
17
parseablehq/parseable
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.
GitHub · Rust · 2,581 stars · 185 forks · +1 stars in 24 hours · Trending score 0.94
-
18
nao1215/filesql
loads CSV, TSV, LTSV, JSON, JSONL, Parquet, XLSX, ACH, and Fedwire files into SQLite; includes prep and frame for cleanup and in-memory transforms
GitHub · Go · 388 stars · 12 forks · +1 stars in 24 hours · Trending score 0.82
-
19
CrunchyData/pg_parquet
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
GitHub · Rust · 697 stars · 40 forks · +2 stars in 24 hours · Trending score 0.81
-
20
nisshi-io/solace-nisshi
Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
GitHub · Rust · 1,934 stars · 87 forks · +1 stars in 24 hours · Trending score 0.80
-
21
ReliablyObserve/victoria-lakehouse
S3-backed cold storage for VictoriaLogs and VictoriaTraces — 60-96% cost reduction with unlimited retention, disaster recovery, and open Parquet format for analytics.
GitHub · Go · 9 stars · 2 forks · +1 stars in 24 hours · Trending score 0.79
-
22
parqdb-io/parqdb
Billion-scale embedded vector database built entirely on Parquet and Arrow.
GitHub · Python · 117 stars · 10 forks · 0 stars in 24 hours · Trending score 0.69
-
23
lakehq/sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
GitHub · Rust · 3,504 stars · 243 forks · 0 stars in 24 hours · Trending score 0.69
-
24
nao1215/sqly
executes SQL against CSV, TSV, LTSV, JSON, JSONL, Parquet, Microsoft Excel™ , ACH, and Fedwire files with shell.
GitHub · Go · 197 stars · 3 forks · +1 stars in 24 hours · Trending score 0.69