ChenLiu-1996/LM-Dispersion
[๐๐๐ ๐ ๐ฎ๐ฌ๐ฎ๐ฒ] Dispersion loss counteracts embedding condensation and improves generalization in small language models
GitHub repository with 107 stars and 5 forks.
Language: Python
Topics: icml, icml-2026, llm, llm-training, llms, manifold-learning, condensation, dispersion, embedding, large-language-models