RKI Metadata Exchange | Software development toolkit for the MEx project that contains utilities for building pipelines and services, including shared code for logging, configuration and data models.
GitHub repository with 11 stars and 2 forks.
Language: Python
Topics: etl, libraries, python, research-data
2026-06-05: 11 stars and 2 forks.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
GitHub repository with 21,391 stars and 5,206 forks.
Trending score: 0.55; stars gained: +2; forks gained: +4.
Language: Python
Topics: bigquery, change-data-capture, data, data-analysis, data-collection, data-engineering
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
GitHub repository with 63,095 stars and 1,679 forks.
Trending score: 0.46; stars gained: -30; forks gained: +4.
Language: Python
Topics: batch-processing, kafka, pathway, python, streaming, machine-learning-algorithms
🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
GitHub repository with 601 stars and 68 forks.
Trending score: 0.14; stars gained: +0; forks gained: +0.
Language: Python
Topics: ai, dataprep, etl, information-retrieval, llm, ml
A system for agentic LLM-powered data processing and ETL
GitHub repository with 3,759 stars and 400 forks.
Trending score: 0.05; stars gained: +0; forks gained: +1.
Language: Python
Topics: agents, data, data-pipelines, document-analysis, document-processing, elt
Fetchez is a lightweight, modular, and highly extendable Python framework designed to orchestrate geospatial data engineering workflows.
GitHub repository with 6 stars and 3 forks.
Trending score: 0.05; stars gained: +0; forks gained: +0.
Language: Python
Topics: data-science, elevation-data, geospatial, gis, cli, earth-science
Data transformation framework for LinkML data models
GitHub repository with 64 stars and 5 forks.
Trending score: 0.04; stars gained: +0; forks gained: +0.
Language: Python
Topics: koza, linkml, obofoundry, etl, knowledge-graph, ontology
The agent that grows with you
GitHub repository with 182,504 stars and 31,292 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 14,053 stars and 885 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,616 stars and 2,272 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,711 stars and 4,695 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,435 stars and 28,046 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, collections, python, python-frameworks, python-libraries, python-tools
Use claude-code for free in the terminal, VSCode extension or discord like OpenClaw (voice supported)
GitHub repository with 32,540 stars and 4,942 forks.
Trending score: 4.56; stars gained: +467; forks gained: +82.
Language: Python
Local-first ETL/ELT studio: a drag-and-drop visual pipeline designer that compiles to SQL and runs on DuckDB. Tiny desktop app, no servers, git-friendly workspaces.
GitHub repository with 285 stars and 21 forks.
Trending score: 2.64; stars gained: +36; forks gained: +0.
Language: Rust
Topics: data-engineering, data-integration, data-pipeline, data-quality, desktop-app, drag-and-drop
SeaTunnel Web is a visual tool for building and watching over your Apache SeaTunnel data pipelines, with drag-and-drop DAGs and simple connector setup.
GitHub repository with 290 stars and 30 forks.
Trending score: 1.85; stars gained: +57; forks gained: +5.
Language: TypeScript
Topics: batch, dag, data-engineering, data-integration, data-pipeline, etl
A high-performance observability data pipeline.
GitHub repository with 21,981 stars and 2,158 forks.
Trending score: 1.62; stars gained: +4; forks gained: +6.
Language: Rust
Topics: agent, cloud-native, data-transformation, datadog, etl, events
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
GitHub repository with 5,547 stars and 483 forks.
Trending score: 1.26; stars gained: +2; forks gained: +1.
Language: Rust
Topics: machine-learning, python, data-engineering, distributed-computing, rust, big-data
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
GitHub repository with 3,134 stars and 192 forks.
Trending score: 1.11; stars gained: +7; forks gained: +1.
Language: Go
Topics: etl, sql, bigquery, cloud-native, distributed-systems, kafka
qData is an open-source data governance and data development platform that integrates ETL, data development, metadata management, data quality, data assets, API services, and AI-powered data Q&A.
GitHub repository with 468 stars and 109 forks.
Trending score: 0.77; stars gained: +5; forks gained: +0.
Language: PLpgSQL
Topics: data-governance, data-middle-platform, chatbi, etl, metadata-management