joezhuo2/LLM-Inference-Engine

A single-GPU LLM inference engine in C++20 and CUDA. It serves TinyLlama-1.1B-Chat-v1.0 in BF16 with FP32 accumulation, matches HuggingFace output token for token, and serves many concurrent requests with a paged KV cache, a paged decode attention kernel, continuous batching, custom fused kernels, sampling on the GPU, and CUDA Graphs.

GitHub repository with 5 stars and 0 forks.

Language: TypeScript

Topics: inference, inference-engine, llm, machine-learning, systems-programming

Open provider repository

24h trend summary

Trending score 0.09, freshness score 0.72, stars gained +0, forks gained +0.

Latest metric snapshot

2026-11-15: 5 stars and 0 forks.

Trending in TypeScript

  1. 1. morluto/rea

    Reverse engineer anything with agents, from app behavior down to native binaries.

    GitHub repository with 460,151 stars and 112,772 forks.

    Trending score: 7.06; stars gained: +4,591; forks gained: +904.

    Language: TypeScript

    Topics: agent-skills, ai, android, claude-code, cli, cpp

  2. 2. pingdotgg/t3code

    The best way to control Claude Code, Codex and more from any computer or phone

    GitHub repository with 60,702 stars and 10,929 forks.

    Trending score: 6.43; stars gained: +2,260; forks gained: +233.

    Language: TypeScript

    Topics: agent-orchestration, agents, ai, chatgpt, claude, claude-code

  3. 3. deepseek-ai/deepseek-harness

    DeepSeek Harness: Everything is a Plugin.

    GitHub repository with 281,169 stars and 34,727 forks.

    Trending score: 6.06; stars gained: +1,332; forks gained: +264.

    Language: TypeScript

    Topics: ai-agents, cordis, dsh, dsh-plugin

  4. 4. DmNote-App/DmNote

    Make it yours. A customizable key viewer for DJMAX RESPECT V and any game.

    GitHub repository with 4,193 stars and 247 forks.

    Trending score: 0.84; stars gained: +0; forks gained: +0.

    Language: TypeScript

    Topics: djmax, dmnote, keyboard, keyoverlay, keyviewer, kps

  5. 5. thedotmack/claude-mem

    Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More

    GitHub repository with 117,155 stars and 10,170 forks.

    Trending score: 5.37; stars gained: +552; forks gained: +52.

    Language: TypeScript

    Topics: ai, ai-agents, ai-memory, anthropic, artificial-intelligence, chromadb

  6. 6. Renhuai123/ziwei-doushu

    紫微斗数开源排盘引擎 — 基于倪海厦《天纪》体系，含完整排盘算法、四化系统、格局知识库、古籍原文数据

    GitHub repository with 18,215 stars and 3,547 forks.

    Trending score: 5.06; stars gained: +381; forks gained: +80.

    Language: TypeScript

    Topics: bazi, chinese-astrology, divination, fortune-telling, nextjs, open-source