Fast local LLM inference on consumer GPUs: big Mixture-of-Experts models that don't fit in VRAM, OpenAI-compatible server, GGUF. A llama.cpp fork.
GitHub repository with 10 stars and 0 forks.
Language: C++
Topics: cuda, gguf, gpu, inference, llama-cpp, llm, local-llm, mixture-of-experts, moe, openai-api
Trending score 0.08, freshness score 0.53, stars gained +0, forks gained +0.
2026-11-15: 10 stars and 0 forks.
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
GitHub repository with 44,322 stars and 4,880 forks.
Trending score: 5.43; stars gained: +645; forks gained: +76.
Language: C++
Tool for automatic PS5 executables porting to Linux and Windows
GitHub repository with 54,024 stars and 5,165 forks.
Trending score: 5.16; stars gained: +462; forks gained: +62.
Language: C++
Topics: anyps5, dynamic-library, game-porting, ps5, ps5-tools, spir-v
LLM inference in C/C++
GitHub repository with 135,134 stars and 25,638 forks.
Trending score: 5.24; stars gained: +558; forks gained: +105.
Language: C++
Topics: ggml
EditHere — 截图、写下意见、直接调整布局，把修改意图一次交给 AI。
GitHub repository with 1,638 stars and 105 forks.
Trending score: 3.17; stars gained: +44; forks gained: +1.
Language: C++
An MCP-based chatbot | 一个基于MCP的聊天机器人
GitHub repository with 33,251 stars and 7,900 forks.
Trending score: 3.81; stars gained: +54; forks gained: +22.
Language: C++
Topics: chatbot, esp32, mcp
The Goose Programming Language
GitHub repository with 3,547 stars and 168 forks.
Trending score: 3.68; stars gained: +67; forks gained: +5.
Language: C++