ttft repositories
Trending repositories tagged ttft, ranked by trending score. Updated daily.
-
1
chenlongapps/opencode-token-usage
OpenCode 2 plugin for session-tree token usage, context window monitoring, estimated costs, and performance metrics (TPS, TTFT, run time).
GitHub · TypeScript · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.41
-
2
NEETnina/dsh-model-master
dsh-model-master(模型选择大师)— model selector for DeepSeek Harness: search across providers, probe any model with a real streaming request to measure TTFT and TPS, and jump from a leaderboard row to a local search for channels of that name.
GitHub · JavaScript · 21 stars · 0 forks · 0 stars in 24 hours · Trending score 0.28
-
3
Moloch-AI/llm-api-benchmark
Open-source LLM API benchmark for measuring inference latency, TTFT, tokens/sec, throughput, reliability and cost across OpenAI-compatible endpoints.
GitHub · Python · 17 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
4
tanavc1/local-llm-autotune
Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.
GitHub · Python · 37 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00
-
5
youngxhui/opencode-sidebar-token-metrics
OpenCode TUI plugin that shows generation speed (tok/s), cache hit rate, and average TTFT in the sidebar
GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
6
alphaparkinc/genpark-edge-inference-latency-telemetry-skill
High-precision edge and on-device LLM inference profiler calculating TTFT, TPOT, tokens/second throughput, and percentile jitter distributions (P50/P90/P99).
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
7
Cansiny0320/token-speed-tester
LLM / Codex 测速与本机历史分析:TTFT、Token 吞吐、流式曲线,支持 CLI、网页和跨平台桌面端。Benchmark LLM / Codex streaming speed and analyze local Codex history with CLI, web & desktop apps.
GitHub · TypeScript · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00