IST-DASLab/GSQ

Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).

GitHub repository with 9 stars and 2 forks.

Language: Python

Topics: gguf, llm, post-training-quantization, quantization

Open provider repository

24h trend summary

Trending score 0.00, activity score 0.00, stars gained +0, forks gained +0.

Latest metric snapshot

2026-06-05: 9 stars and 2 forks.

Similar repositories

  1. 1. Andyyyy64/whichllm

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

    GitHub repository with 2,759 stars and 158 forks.

    Trending score: 1.88; stars gained: +95; forks gained: +7.

    Language: Python

    Topics: ai, apple-silicon, benchmarks, cli, command-line-tool, gguf

  2. 2. intel/auto-round

    A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.

    GitHub repository with 1,436 stars and 135 forks.

    Trending score: 1.06; stars gained: +6; forks gained: +0.

    Language: Python

    Topics: gguf, int4, llms, mxfp4, nvfp4, quantization

  3. 3. hogeheer499-commits/strix-halo-guide

    AMD Strix Halo local LLM guide: direct 100.0 t/s 30B Qwen MoE on Ryzen AI MAX+ 395 / Radeon 8060S. Setup, benchmarks, raw evidence.

    GitHub repository with 91 stars and 4 forks.

    Trending score: 0.98; stars gained: +7; forks gained: +0.

    Language: Python

    Topics: amd, benchmark, gfx1151, inference, llama-cpp, llm

  4. 4. Rubonal4649/ai-engineering-from-scratch

    Build AI engineering skills from scratch with 260+ lessons, 20 phases, and hands-on tools for practical learning

    GitHub repository with 9 stars and 1 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: agentic-patterns, agentic-workflow, ai-agent-frameworks, ai-engineering, course, educational

  5. 5. notwitcheer/llm-bench-rig

    Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.

    GitHub repository with 9 stars and 2 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: benchmarking, cuda, fastapi, gguf, llama-cpp, llm

  6. 6. eullm/eullm

    Open-source platform for creating, distributing and running sovereign EU-compliant LLMs. Verticalize any model for your domain, language and brand. AI Act ready.

    GitHub repository with 25 stars and 1 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: ai-sovereignty, data-sovereignty, eu-ai-act, europe, fine-tuning, gdpr

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 181,624 stars and 31,163 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 13,361 stars and 853 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research → write → review → revise → finalize

    GitHub repository with 27,422 stars and 2,253 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. anthropics/financial-services

    GitHub repository with 30,002 stars and 4,224 forks.

    Trending score: 4.88; stars gained: +688; forks gained: +114.

    Language: Python

  5. 5. virgiliojr94/book-to-skill

    Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.

    GitHub repository with 4,250 stars and 534 forks.

    Trending score: 4.88; stars gained: +476; forks gained: +68.

    Language: Python

  6. 6. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,371 stars and 28,044 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

Trending topic: gguf

  1. 1. Andyyyy64/whichllm

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

    GitHub repository with 2,759 stars and 158 forks.

    Trending score: 1.88; stars gained: +95; forks gained: +7.

    Language: Python

    Topics: ai, apple-silicon, benchmarks, cli, command-line-tool, gguf

  2. 2. Michael-A-Kuykendall/shimmy

    ⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

    GitHub repository with 5,306 stars and 499 forks.

    Trending score: 1.87; stars gained: +5; forks gained: +2.

    Language: Rust

    Topics: llama, llamacpp, llm-inference, ollama-api, command-line-tool, gguf

  3. 3. timtoole02/Camelid

    Camelid: a Rust-native local inference backend with evidence-gated model compatibility.

    GitHub repository with 49 stars and 10 forks.

    Trending score: 1.25; stars gained: +17; forks gained: +2.

    Language: Rust

    Topics: apple-silicon, gguf, inference, llama, llm, local-first

  4. 4. DaggerSlicer34/koboldcpp

    KoboldCpp — local llm cpu.

    GitHub repository with 21 stars and 0 forks.

    Trending score: 1.20; stars gained: +13; forks gained: +0.

    Topics: cpu-inference, gguf, koboldcpp, local-llm, open-source, text-generation

  5. 5. intel/auto-round

    A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.

    GitHub repository with 1,436 stars and 135 forks.

    Trending score: 1.06; stars gained: +6; forks gained: +0.

    Language: Python

    Topics: gguf, int4, llms, mxfp4, nvfp4, quantization

  6. 6. hogeheer499-commits/strix-halo-guide

    AMD Strix Halo local LLM guide: direct 100.0 t/s 30B Qwen MoE on Ryzen AI MAX+ 395 / Radeon 8060S. Setup, benchmarks, raw evidence.

    GitHub repository with 91 stars and 4 forks.

    Trending score: 0.98; stars gained: +7; forks gained: +0.

    Language: Python

    Topics: amd, benchmark, gfx1151, inference, llama-cpp, llm