Interactive-Active-AI/NextTransformer
:sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers, with compute-matched benchmarking and a platform for autonomous architecture research.
GitHub repository with 171 stars and 10 forks.
Language: Python
Topics: auto-research, benchmark, deep-learning, language-models, linear-attention, llm, looped-transformer, pytorch, sparse-attention, transformer