deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
GitHub repository with 42,464 stars and 4,850 forks.
Language: Python
Topics: deep-learning, pytorch, gpu, machine-learning, billion-parameters, data-parallelism, model-parallelism, inference, pipeline-parallelism, compression