fkie-cad/Logprep

log data pre processing, generation and shipping in python

GitHub repository with 36 stars and 10 forks.

Language: Python

Topics: etl, kafka, log, logdata, loggenerator, logshipper, opensearch, preprocessing, python, soar

Open provider repository

Latest metric snapshot

2026-06-05: 36 stars and 10 forks.

Similar repositories

  1. 1. apache/airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    GitHub repository with 45,698 stars and 17,173 forks.

    Trending score: 1.23; stars gained: +18; forks gained: +20.

    Language: Python

    Topics: airflow, apache, apache-airflow, automation, dag, data-engineering

  2. 2. dagster-io/dagster

    An orchestration platform for the development, production, and observation of data assets.

    GitHub repository with 15,627 stars and 2,155 forks.

    Trending score: 1.02; stars gained: +7; forks gained: +1.

    Language: Python

    Topics: data-pipelines, dagster, workflow, data-science, workflow-automation, python

  3. 3. airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    GitHub repository with 21,391 stars and 5,205 forks.

    Trending score: 0.55; stars gained: +2; forks gained: +4.

    Language: Python

    Topics: data, pipeline, data-analysis, data-engineering, java, python

  4. 4. pathwaycom/pathway

    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

    GitHub repository with 63,097 stars and 1,679 forks.

    Trending score: 0.46; stars gained: -30; forks gained: +4.

    Language: Python

    Topics: batch-processing, kafka, pathway, python, streaming, machine-learning-algorithms

  5. 5. databricks/dbt-databricks

    A dbt adapter for Databricks.

    GitHub repository with 360 stars and 203 forks.

    Trending score: 0.44; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: databricks, dbt, etl, sql

  6. 6. catalyst-cooperative/pudl

    The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

    GitHub repository with 590 stars and 138 forks.

    Trending score: 0.31; stars gained: +0; forks gained: +0.

    Language: Python

    Topics: open-data, ferc, eia, energy, utility, climate

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 181,769 stars and 31,185 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 13,361 stars and 853 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research → write → review → revise → finalize

    GitHub repository with 27,484 stars and 2,256 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. anthropics/financial-services

    GitHub repository with 30,029 stars and 4,231 forks.

    Trending score: 4.88; stars gained: +688; forks gained: +114.

    Language: Python

  5. 5. virgiliojr94/book-to-skill

    Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.

    GitHub repository with 4,250 stars and 534 forks.

    Trending score: 4.88; stars gained: +476; forks gained: +68.

    Language: Python

  6. 6. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,371 stars and 28,044 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

Trending topic: etl

  1. 1. SouravRoy-ETL/duckle

    Local-first ETL/ELT studio: a drag-and-drop visual pipeline designer that compiles to SQL and runs on DuckDB. Tiny desktop app, no servers, git-friendly workspaces.

    GitHub repository with 277 stars and 20 forks.

    Trending score: 2.64; stars gained: +36; forks gained: +0.

    Language: Rust

    Topics: data-engineering, data-integration, data-pipeline, data-quality, desktop-app, drag-and-drop

  2. 2. cocoindex-io/cocoindex

    Incremental engine for long horizon agents 🌟 Star if you like it!

    GitHub repository with 10,182 stars and 799 forks.

    Trending score: 2.57; stars gained: +20; forks gained: +3.

    Language: Rust

    Topics: agentic-data-framework, ai, ai-agents, change-data-capture, codebase-intelligence, context-engineering

  3. 3. weifuwan/seatunnel-web

    SeaTunnel Web is a visual tool for building and watching over your Apache SeaTunnel data pipelines, with drag-and-drop DAGs and simple connector setup.

    GitHub repository with 279 stars and 30 forks.

    Trending score: 1.85; stars gained: +57; forks gained: +5.

    Language: TypeScript

    Topics: batch, dag, data-engineering, data-integration, data-pipeline, etl

  4. 4. Eventual-Inc/Daft

    High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

    GitHub repository with 5,546 stars and 483 forks.

    Trending score: 1.26; stars gained: +2; forks gained: +1.

    Language: Rust

    Topics: machine-learning, python, data-engineering, distributed-computing, rust, big-data

  5. 5. apache/airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    GitHub repository with 45,698 stars and 17,173 forks.

    Trending score: 1.23; stars gained: +18; forks gained: +20.

    Language: Python

    Topics: airflow, apache, apache-airflow, automation, dag, data-engineering

  6. 6. PeerDB-io/peerdb

    Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

    GitHub repository with 3,134 stars and 193 forks.

    Trending score: 1.11; stars gained: +7; forks gained: +1.

    Language: Go

    Topics: etl, sql, bigquery, cloud-native, distributed-systems, kafka