ttft repositories

Trending repositories tagged ttft, ranked by trending score. Updated daily.

  1. 1
    chenlongapps/opencode-token-usage

    OpenCode 2 plugin for session-tree token usage, context window monitoring, estimated costs, and performance metrics (TPS, TTFT, run time).

    GitHub · TypeScript · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.41

  2. 2
    NEETnina/dsh-model-master

    dsh-model-master(模型选择大师)— model selector for DeepSeek Harness: search across providers, probe any model with a real streaming request to measure TTFT and TPS, and jump from a leaderboard row to a local search for channels of that name.

    GitHub · JavaScript · 21 stars · 0 forks · 0 stars in 24 hours · Trending score 0.28

  3. 3
    Moloch-AI/llm-api-benchmark

    Open-source LLM API benchmark for measuring inference latency, TTFT, tokens/sec, throughput, reliability and cost across OpenAI-compatible endpoints.

    GitHub · Python · 17 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  4. 4
    tanavc1/local-llm-autotune

    Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

    GitHub · Python · 37 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00

  5. 5
    youngxhui/opencode-sidebar-token-metrics

    OpenCode TUI plugin that shows generation speed (tok/s), cache hit rate, and average TTFT in the sidebar

    GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    alphaparkinc/genpark-edge-inference-latency-telemetry-skill

    High-precision edge and on-device LLM inference profiler calculating TTFT, TPOT, tokens/second throughput, and percentile jitter distributions (P50/P90/P99).

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  7. 7
    Cansiny0320/token-speed-tester

    LLM / Codex 测速与本机历史分析:TTFT、Token 吞吐、流式曲线,支持 CLI、网页和跨平台桌面端。Benchmark LLM / Codex streaming speed and analyze local Codex history with CLI, web & desktop apps.

    GitHub · TypeScript · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00