mybigday/llama.node
Node.js binding of llama.cpp
GitHub repository with 19 stars and 4 forks.
Language: C++
Topics: llama, llama-cpp, llamacpp, llm, node-js, nodejs
Node.js binding of llama.cpp
GitHub repository with 19 stars and 4 forks.
Language: C++
Topics: llama, llama-cpp, llamacpp, llm, node-js, nodejs
2026-06-05: 19 stars and 4 forks.
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
GitHub repository with 1,494 stars and 480 forks.
Trending score: 1.82; stars gained: +7; forks gained: +5.
Language: C++
Topics: accelerator, ai, cuda, deepseek, gpu, img-gen
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
GitHub repository with 4,212 stars and 331 forks.
Trending score: 1.34; stars gained: +13; forks gained: +1.
Language: C++
Topics: amd, llama, llm, llm-inference, local-server, mistral
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
GitHub repository with 1,429 stars and 98 forks.
Trending score: 1.04; stars gained: +1; forks gained: +0.
Language: C++
Topics: amd, deepseek, llama, llm, npu
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
GitHub repository with 117 stars and 26 forks.
Trending score: 0.05; stars gained: +0; forks gained: +0.
Language: C++
Topics: facebook, flutter-ai, gemma, ggml, gguf, llama
LLM inference in C/C++
GitHub repository with 114,639 stars and 19,177 forks.
Trending score: 4.40; stars gained: +304; forks gained: +99.
Language: C++
Topics: ggml
DuckDB is an analytical in-process SQL database management system
GitHub repository with 38,611 stars and 3,295 forks.
Trending score: 3.50; stars gained: +40; forks gained: +6.
Language: C++
Topics: sql, database, olap, analytics, embedded-database
Community maintained hardware plugin for vLLM on Ascend
GitHub repository with 2,195 stars and 1,342 forks.
Trending score: 3.25; stars gained: +16; forks gained: +22.
Language: C++
Topics: ascend, inference, llm, llm-serving, llmops, mlops
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
GitHub repository with 121,534 stars and 17,232 forks.
Trending score: 3.02; stars gained: +16; forks gained: +2.
Language: C++
ClickHouse® is a real-time analytics database management system
GitHub repository with 47,818 stars and 8,465 forks.
Trending score: 2.96; stars gained: +53; forks gained: +10.
Language: C++
Topics: ai, analytics, big-data, clickhouse, cloud-native, cpp
Truly independent web browser
GitHub repository with 63,750 stars and 3,075 forks.
Trending score: 2.89; stars gained: +52; forks gained: +5.
Language: C++
Topics: browser, browser-engine
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
GitHub repository with 173,194 stars and 16,443 forks.
Trending score: 3.96; stars gained: +222; forks gained: +40.
Language: Go
Topics: deepseek, gemma, gemma3, glm, go, golang
A high-throughput and memory-efficient inference and serving engine for LLMs
GitHub repository with 81,949 stars and 17,658 forks.
Trending score: 3.75; stars gained: +79; forks gained: +46.
Language: Python
Topics: amd, blackwell, cuda, deepseek, deepseek-v3, gpt
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
GitHub repository with 46,677 stars and 4,135 forks.
Trending score: 2.96; stars gained: +48; forks gained: +7.
Language: Go
Topics: llama, ai, llm, stable-diffusion, api, tts
A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.
GitHub repository with 5,102 stars and 541 forks.
Trending score: 2.51; stars gained: +11; forks gained: +1.
Language: Python
Topics: ascend, cuda, deepseek, distributed-inference, genai, high-performance-inference
A model-driven approach to building AI agents in just a few lines of code.
GitHub repository with 6,023 stars and 863 forks.
Trending score: 2.33; stars gained: +23; forks gained: +2.
Language: Python
Topics: agentic, agentic-ai, agents, ai, anthropic, autonomous-agents
A list of free LLM inference resources accessible via API.
GitHub repository with 22,810 stars and 2,340 forks.
Trending score: 1.88; stars gained: +96; forks gained: +10.
Language: Python
Topics: ai, claude, gemini, llama, llm, openai