GitHub · C

prabanta-dev/janas

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

Stars
735
Forks
73
Stars gained in 24 hours
0
Forks gained in 24 hours
0

Topics: avx2, c, cpu-inference, gguf, inference-engine, linux, llm, local-llm, mixture-of-experts, moe

Latest data point: Nov 21, 2026 · 735 stars · 73 forks

Open on GitHub

Trending in C

  1. 1
    Zagitta/gpu-unlock

    Your GeForce runs AI at half speed. This fixes it for 20/30/40 series cards. Up to 2× FP16 / BF16 / TF32 tensor throughput

    GitHub · C · 20,627 stars · 2,164 forks · +207 stars in 24 hours · Trending score 4.72

  2. 2
    JustVugg/colibri

    A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.

    GitHub · C · 52,559 stars · 6,368 forks · +508 stars in 24 hours · Trending score 5.27

  3. 3
    ly05010419/MacNativeGames

    Play your own Tears of the Kingdom and Breath of the Wild natively on Apple silicon Mac, iPhone and iPad. Not an emulator: the game's ARM64 code runs directly, NVN rebuilt on Metal. Bring your own game.

    GitHub · C · 8,142 stars · 1,200 forks · +77 stars in 24 hours · Trending score 3.86

  4. 4
    Revivedx/SavageWindRecomp

    Work-in-progress static recompilation of The Legend of Zelda: Breath of the Wild (Switch, v1.9.0) for Windows and Linux. Bring your own dump: no game files, keys or dumping tools included.

    GitHub · C · 4,907 stars · 275 forks · +110 stars in 24 hours · Trending score 4.07

  5. 5
    windows-GPU-UNLOCK/Windows-GPU-UNLOCK

    Windows GPU UNLOCK: RTX3090 UEFI port, Korean no-reset Windows boot guide, verified source and benchmark evidence

    GitHub · C · 2,338 stars · 261 forks · +32 stars in 24 hours · Trending score 3.15

  6. 6
    Genymobile/scrcpy

    Display and control your Android device

    GitHub · C · 155,306 stars · 14,247 forks · +131 stars in 24 hours · Trending score 4.15