triton-inference-server/server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
GitHub repository with 10,732 stars and 1,790 forks.
Language: Python
Topics: cloud, datacenter, deep-learning, edge, gpu, inference, machine-learning