walkinglabs/modern-llm-notebook
A hands-on course for building modern LLMs from scratch in PyTorch, with 23 runnable Jupyter Notebooks covering tokenizers, attention, MoE, RLHF, inference, evaluation, and distillation.
GitHub repository with 38 stars and 9 forks.
Language: Jupyter Notebook
Topics: ai, attention, finetune, gpt, large-language-models, llm, notebook, pretrain, transformer, tutorial