The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
GitHub repository with 288 stars and 50 forks.
Language: Python
Topics: big-data, configuration-driven, data-engineering, data-quality, databricks, delta-lake, framework, great-expectations, lakehouse, spark
2026-06-04: 288 stars and 50 forks.
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
GitHub repository with 1,347 stars and 187 forks.
Trending score: 0.28; stars gained: +0; forks gained: +0.
Language: Python
Topics: oneapi, scikit-learn, machine-learning-algorithms, data-analysis, machine-learning, python
A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
GitHub repository with 365 stars and 122 forks.
Trending score: 0.09; stars gained: +0; forks gained: +0.
Language: Python
Topics: python, big-data, data-processing, multicloud, big-data-analytics, serverless
Read and write Neuroglancer datasets programmatically.
GitHub repository with 173 stars and 53 forks.
Trending score: 0.05; stars gained: +0; forks gained: +0.
Language: Python
Topics: neuroglancer, volumetric-data, python, cloud, numpy, connectomics
Server for the ListenBrainz project, including the front-end (javascript/react) code that it serves and all of the data processing components that LB uses.
GitHub repository with 954 stars and 344 forks.
Trending score: 0.05; stars gained: +0; forks gained: +0.
Language: Python
Topics: database, listenbrainz-server, web, big-data, music, python
The agent that grows with you
GitHub repository with 181,789 stars and 31,193 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 13,361 stars and 853 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,484 stars and 2,256 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,622 stars and 4,680 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
GitHub repository with 30,029 stars and 4,231 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.
GitHub repository with 4,250 stars and 534 forks.
Trending score: 4.88; stars gained: +476; forks gained: +68.
Language: Python
ClickHouse® is a real-time analytics database management system
GitHub repository with 47,833 stars and 8,469 forks.
Trending score: 2.96; stars gained: +53; forks gained: +10.
Language: C++
Topics: ai, analytics, big-data, clickhouse, cloud-native, cpp
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
GitHub repository with 11,760 stars and 2,434 forks.
Trending score: 2.61; stars gained: +10; forks gained: +1.
Language: Java
Topics: analytics, big-data, cloudnative, database, datalake, delta-lake
Apache Beam is a unified programming model for Batch and Streaming data processing.
GitHub repository with 8,605 stars and 4,577 forks.
Trending score: 2.18; stars gained: +5; forks gained: +4.
Language: Java
Topics: batch, beam, big-data, golang, java, python
Apache DataFusion SQL Query Engine
GitHub repository with 8,848 stars and 2,153 forks.
Trending score: 2.07; stars gained: +6; forks gained: +3.
Language: Rust
Topics: arrow, big-data, dataframe, datafusion, olap, python
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
GitHub repository with 5,546 stars and 483 forks.
Trending score: 1.26; stars gained: +2; forks gained: +1.
Language: Rust
Topics: machine-learning, python, data-engineering, distributed-computing, rust, big-data
The AI search platform
GitHub repository with 6,948 stars and 717 forks.
Trending score: 1.18; stars gained: +8; forks gained: +0.
Language: Java
Topics: ai, big-data, java, machine-learning, rag, search