GitHub · Python
modelship-ai/modelship
Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve.
- Stars
- 54
- Forks
- 4
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: agentic, diffusers, embeddings, gpu, image-generation, inference-server, llama-cpp, llm, multimodal, openai-api
Latest data point: Nov 21, 2026 · 54 stars · 4 forks