ai-dynamo/flextensor
FlexTensor is a tensor offloading and management library for PyTorch that enables running large models on limited GPU memory by intelligently offloading tensors between GPU and CPU memory.
GitHub repository with 104 stars and 12 forks.
Language: Python