llm-d/llm-d-inference-sim

A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

GitHub repository with 143 stars and 96 forks.

Language: Go

Topics: incubating

Open provider repository

Latest metric snapshot

2026-06-05: 143 stars and 96 forks.

Similar repositories

  1. 1. llm-d/llm-d-kv-cache

    Distributed KV cache scheduling & offloading libraries

    GitHub repository with 152 stars and 138 forks.

    Trending score: 0.49; stars gained: +2; forks gained: +2.

    Language: Go

    Topics: ai, incubating

Trending in Go

  1. 1. esengine/DeepSeek-Reasonix

    DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.

    GitHub repository with 18,420 stars and 1,092 forks.

    Trending score: 5.71; stars gained: +1,388; forks gained: +87.

    Language: Go

    Topics: agent, agent-framework, ai-agent, ai-coding, cli, coding-agent

  2. 2. alibaba/open-code-review

    Battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in fine-tuned ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

    GitHub repository with 2,523 stars and 124 forks.

    Trending score: 4.93; stars gained: +1,116; forks gained: +39.

    Language: Go

    Topics: agent, code-review, code-review-assistant, harness, repository-level-context

  3. 3. ollama/ollama

    Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    GitHub repository with 173,245 stars and 16,455 forks.

    Trending score: 3.96; stars gained: +222; forks gained: +40.

    Language: Go

    Topics: llama, llm, llms, go, golang, ollama

  4. 4. MatinSenPai/SenPaiScanner

    A light-weight scanner for Cloudflare IPs, written in Golang

    GitHub repository with 1,222 stars and 75 forks.

    Trending score: 3.75; stars gained: +126; forks gained: +5.

    Language: Go

  5. 5. maximhq/bifrost

    Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

    GitHub repository with 5,502 stars and 698 forks.

    Trending score: 3.70; stars gained: +61; forks gained: +12.

    Language: Go

    Topics: ai-gateway, gateway, gateway-services, generative-ai, guardrails, llm

  6. 6. nianzhibai/91

    nine one

    GitHub repository with 947 stars and 284 forks.

    Trending score: 3.40; stars gained: +40; forks gained: +9.

    Language: Go

Trending topic: incubating

  1. 1. llm-d/llm-d-kv-cache

    Distributed KV cache scheduling & offloading libraries

    GitHub repository with 152 stars and 138 forks.

    Trending score: 0.49; stars gained: +2; forks gained: +2.

    Language: Go

    Topics: ai, incubating