hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
GitHub repository with 41,440 stars and 4,498 forks.
Language: Python
Topics: ai, big-model, data-parallelism, deep-learning, distributed-computing, foundation-models, heterogeneous-training, hpc, inference, large-scale