ur-grue/toptop
The local-inference observability layer for your terminal: live tokens/sec, VRAM-spill & throttle warnings, the GPU metrics nvidia-smi can't show. Also a gorgeous htop/btop-class system monitor. Rust, zero deps.
GitHub repository with 15 stars and 2 forks.
Language: Rust
Topics: btop, gpu-monitoring, htop, inference, llama-cpp, llm, llmops, nvidia, observability, ollama