High-speed PII masking as a Polars plugin — powered by Rust
GitHub repository with 15 stars and 0 forks.
Language: Python
Topics: data-engineering, gdpr, pii, polars, rust, arrow, credit-card, cybersecurity, data-anonymization, data-masking
Trending score 0.72, activity score 0.05, stars gained +4, forks gained +0.
2026-06-05: 15 stars and 0 forks.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
GitHub repository with 45,703 stars and 17,175 forks.
Trending score: 1.23; stars gained: +18; forks gained: +20.
Language: Python
Topics: airflow, apache, apache-airflow, automation, dag, data-engineering
An orchestration platform for the development, production, and observation of data assets.
GitHub repository with 15,628 stars and 2,155 forks.
Trending score: 1.02; stars gained: +7; forks gained: +1.
Language: Python
Topics: data-pipelines, dagster, workflow, data-science, workflow-automation, python
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
GitHub repository with 9,495 stars and 729 forks.
Trending score: 0.98; stars gained: +7; forks gained: -1.
Language: Python
Topics: xonsh, devops, iterm2, data-engineering, security-automation, raspberry-pi
Zero-config entity resolution that scales from a CSV to 100M+ rows on a Ray cluster (verified: 100M deduped in 213s, 0.30 GB driver). Fuzzy + exact + probabilistic dedupe, identity graph, PPRL, LLM boost. Python + full TypeScript port; SQL-native in PostgreSQL & DuckDB; MCP/REST servers, dbt + Airflow recipes.
GitHub repository with 79 stars and 10 forks.
Trending score: 0.94; stars gained: +8; forks gained: +1.
Language: Python
Topics: data-engineering, data-quality, deduplication, entity-resolution, fuzzy-matching, llm
High-speed PII masking as a Polars plugin — powered by Rust
GitHub repository with 15 stars and 0 forks.
Trending score: 0.72; stars gained: +4; forks gained: +0.
Language: Python
Topics: data-engineering, gdpr, pii, polars, rust, arrow
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
GitHub repository with 21,391 stars and 5,205 forks.
Trending score: 0.55; stars gained: +2; forks gained: +4.
Language: Python
Topics: data, pipeline, data-analysis, data-engineering, java, python
The agent that grows with you
GitHub repository with 181,939 stars and 31,220 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 13,768 stars and 870 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,537 stars and 2,264 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,622 stars and 4,680 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
GitHub repository with 30,060 stars and 4,235 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,396 stars and 28,042 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools
ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, and any AI agent to query data accurately through MCP with skills, memory and a semantic layer
GitHub repository with 892 stars and 46 forks.
Trending score: 2.76; stars gained: +24; forks gained: +1.
Language: TypeScript
Topics: agent, agent-skills, agents, ai-agent, ai-agents, analytics
Apache Superset is a Data Visualization and Data Exploration Platform
GitHub repository with 73,180 stars and 17,522 forks.
Trending score: 2.73; stars gained: +24; forks gained: +19.
Language: TypeScript
Topics: analytics, apache, apache-superset, asf, bi, business-analytics
Local-first ETL/ELT studio: a drag-and-drop visual pipeline designer that compiles to SQL and runs on DuckDB. Tiny desktop app, no servers, git-friendly workspaces.
GitHub repository with 279 stars and 20 forks.
Trending score: 2.64; stars gained: +36; forks gained: +0.
Language: Rust
Topics: data-engineering, data-integration, data-pipeline, data-quality, desktop-app, drag-and-drop
Incremental engine for long horizon agents 🌟 Star if you like it!
GitHub repository with 10,184 stars and 799 forks.
Trending score: 2.57; stars gained: +20; forks gained: +3.
Language: Rust
Topics: ai, change-data-capture, data-indexing, etl, indexing, python
SeaTunnel Web is a visual tool for building and watching over your Apache SeaTunnel data pipelines, with drag-and-drop DAGs and simple connector setup.
GitHub repository with 284 stars and 30 forks.
Trending score: 1.85; stars gained: +57; forks gained: +5.
Language: TypeScript
Topics: batch, dag, data-engineering, data-integration, data-pipeline, etl
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
GitHub repository with 9,064 stars and 776 forks.
Trending score: 1.62; stars gained: +2; forks gained: +0.
Language: Rust
Topics: apache-iceberg, data-engineering, database, etl-pipeline, event-streaming, kafka