data-profiling repositories

Trending repositories tagged data-profiling, ranked by trending score. Updated daily.

  1. 1
    open-metadata/OpenMetadata

    The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

    GitHub · TypeScript · 15,826 stars · 2,530 forks · +10 stars in 24 hours · Trending score 2.46

  2. 2
    DataWithBaraa/claude-code-data-engineering-skills

    16 Claude Code skills for data engineers: profile a new source, investigate a failed run, review a change, document the platform. Most end in a page you can share.

    GitHub · HTML · 106 stars · 38 forks · +2 stars in 24 hours · Trending score 1.21

  3. 3
    databrickslabs/dqx

    Databricks framework to validate Data Quality of pySpark DataFrames and Tables

    GitHub · Python · 486 stars · 166 forks · 0 stars in 24 hours · Trending score 0.65

  4. 4
    Desbordante/desbordante-core

    Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

    GitHub · C++ · 521 stars · 109 forks · 0 stars in 24 hours · Trending score 0.45

  5. 5
    PerryLink/dsh-data-quality

    DeepSeek Harness plugin: deterministic data profiling, cleaning, and verification (dsh-data-quality)

    GitHub · TypeScript · 54 stars · 1 forks · 0 stars in 24 hours · Trending score 0.22

  6. 6
    AndreaBozzo/dataprof

    Data profiling and quality gates for CSV, JSON, Parquet and DataFrames. Rust core, Python API.

    GitHub · Rust · 34 stars · 29 forks · 0 stars in 24 hours · Trending score 0.19

  7. 7
    polyaxon/haupt

    Lineage metadata API, artifacts streams, sandbox, API, and spaces for Polyaxon

    GitHub · Python · 452 stars · 204 forks · 0 stars in 24 hours · Trending score 0.04

  8. 8
    fivetran/great_expectations

    Always know what to expect from your data.

    GitHub · Python · 11,927 stars · 1,888 forks · 0 stars in 24 hours · Trending score 0.04

  9. 9
    polyaxon/traceml

    Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

    GitHub · Python · 533 stars · 47 forks · 0 stars in 24 hours · Trending score 0.02

  10. 10
    sodadata/soda-core

    Data Contracts engine for the modern data stack. https://www.soda.io

    GitHub · Python · 2,457 stars · 298 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    opendatadiscovery/odd-platform

    First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

    GitHub · Java · 1,441 stars · 152 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    genc-murat/datarust

    A pure-Rust workspace for classical ML: scikit-learn-style preprocessing & models (datarust) plus one-call data profiling & quality reports (datarust-profile). Zero dependencies by default.

    GitHub · Rust · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    alvarodiez20/pysuricata

    Single-pass exploratory data analysis on streaming algorithms. Bounded memory at any dataset size, pandas and Polars, self-contained HTML reports.

    GitHub · Python · 17 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    Data-Centric-AI-Community/fg-data-profiling

    1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

    GitHub · Python · 13,747 stars · 1,802 forks · 0 stars in 24 hours · Trending score 0.00