datafusion repositories

Trending repositories tagged datafusion, ranked by trending score. Updated daily.

  1. 1
    ModernRelay/omnigraph

    Object-storage native graph database with branching and typed ontology

    GitHub · Rust · 3,108 stars · 340 forks · +136 stars in 24 hours · Trending score 4.32

  2. 2
    apache/datafusion

    Apache DataFusion SQL Query Engine

    GitHub · Rust · 9,620 stars · 2,663 forks · +13 stars in 24 hours · Trending score 2.32

  3. 3
    apache/datafusion-iceberg

    Apache DataFusion Iceberg Integration

    GitHub · Rust · 35 stars · 39 forks · +3 stars in 24 hours · Trending score 1.25

  4. 4
    Jxck-S/dashcraft

    DashCraft: BI dashboards and data models; an open-source, clean-room Power BI file explorer and report renderer, written from scratch in Rust. Open PBIX, PBIP, PBIT, TMDL and model.bim offline on macOS, Windows and Linux. No Power BI Desktop, no VM, no cloud login.

    GitHub · Rust · 38 stars · 4 forks · +2 stars in 24 hours · Trending score 1.24

  5. 5
    apache/auron

    Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.

    GitHub · Rust · 1,849 stars · 252 forks · +3 stars in 24 hours · Trending score 1.23

  6. 6
    apache/datafusion-spark

    Apache Spark-compatible expressions for Apache DataFusion

    GitHub · Rust · 11 stars · 21 forks · +1 stars in 24 hours · Trending score 1.17

  7. 7
    ibis-project/ibis

    the portable Python dataframe library

    GitHub · Python · 6,705 stars · 789 forks · +1 stars in 24 hours · Trending score 1.02

  8. 8
    apache/datafusion-comet

    Apache DataFusion Comet Spark Accelerator

    GitHub · Scala · 1,325 stars · 419 forks · +1 stars in 24 hours · Trending score 1.02

  9. 9
    ClickHouse/ClickBench

    ClickBench: a Benchmark For Analytical Databases

    GitHub · Shell · 1,170 stars · 338 forks · +1 stars in 24 hours · Trending score 0.99

  10. 10
    nisshi-io/solace-nisshi

    Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

    GitHub · Rust · 1,934 stars · 87 forks · +1 stars in 24 hours · Trending score 0.80

  11. 11
    goldsky-io/streamling

    Data streaming runtime focused on performance, consistency, and extensibility. Write plugins in Rust or WASM and process data with data guarantees.

    GitHub · Rust · 111 stars · 9 forks · +1 stars in 24 hours · Trending score 0.73

  12. 12
    parqdb-io/parqdb

    Billion-scale embedded vector database built entirely on Parquet and Arrow.

    GitHub · Python · 117 stars · 10 forks · 0 stars in 24 hours · Trending score 0.69

  13. 13
    lakehq/sail

    Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

    GitHub · Rust · 3,504 stars · 243 forks · 0 stars in 24 hours · Trending score 0.69

  14. 14
    arkflow-rs/arkflow

    High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

    GitHub · Rust · 1,317 stars · 51 forks · +1 stars in 24 hours · Trending score 0.63

  15. 15
    datafusion-contrib/datafusion-variant

    user-defined functions for Variant handling in Datafusion

    GitHub · Rust · 21 stars · 18 forks · +1 stars in 24 hours · Trending score 0.55

  16. 16
    datafusion-contrib/datafusion-distributed

    Library for bringing distributed capabilities to Apache DataFusion

    GitHub · Rust · 176 stars · 92 forks · 0 stars in 24 hours · Trending score 0.52

  17. 17
    NOFireAI/ravel

    A distributed OpenTelemetry-native columnar datastore whose only backend is object storage.

    GitHub · Rust · 50 stars · 6 forks · 0 stars in 24 hours · Trending score 0.24

  18. 18
    biodatageeks/polars-bio

    Blazing-Fast Bioinformatic Operations on Python DataFrames

    GitHub · Python · 208 stars · 37 forks · 0 stars in 24 hours · Trending score 0.20

  19. 19
    nuthatch-org/nuthatch

    Be your own indexer. One Rust binary, one command, live indexed API in under two minutes. No mandatory third-party data dependency.

    GitHub · Rust · 7 stars · 5 forks · 0 stars in 24 hours · Trending score 0.19

  20. 20
    bohmian-ai/wyrd

    Build verification workflows that fit your systems. Declare requirements, observe real behavior, and verify outcomes with open-source building blocks.

    GitHub · Rust · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19

  21. 21
    madesroches/micromegas

    Unified observability for logs, metrics and traces — low overhead instrumentation (Rust, Unreal Engine 5), OTLP ingestion, SQL analytics on DataFusion over Parquet, presentation through notebooks, Grafana and Python. Self-hosted.

    GitHub · Rust · 56 stars · 10 forks · 0 stars in 24 hours · Trending score 0.10

  22. 22
    lakesoul-io/LakeSoul

    An open lakehouse engine for agents — Postgres-native, vector-native and Python-native. Speaks PostgreSQL, runs on your object storage, written in Rust.

    GitHub · Rust · 3,261 stars · 427 forks · 0 stars in 24 hours · Trending score 0.10

  23. 23
    visorcraft/MongrelDB

    A fast embedded+server columnar database with SQL, vector search, full-text search, and AI-native retrieval. Dozens of languages supported. Written in Rust.

    GitHub · Rust · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  24. 24
    datafusion-contrib/datafusion-dft

    Batteries included CLI, TUI, and server implementations for DataFusion.

    GitHub · Rust · 206 stars · 25 forks · 0 stars in 24 hours · Trending score 0.07