GitHub · Python
intel/inference-toolkit
Enterprise-grade, high-performance LLM serving on Kubernetes. OpenAI-compatible inference powered by vLLM and OpenVINO™ Model Server behind a unified AI gateway, with NUMA-aware CPU optimization for Intel® Xeon® - production model serving, routing, and security built in.
- Stars
- 8
- Forks
- 15
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: genai, generative-ai, inference-server, kubernetes, llm-inference, llm-serving, llmops, mlops, model-serving, openai
Latest data point: Nov 20, 2026 · 8 stars · 15 forks