prabeakarve/microgpt
A from-scratch, dependency-free GPT implementation in pure NumPy: byte-level tokenizer, multi-head self-attention, Adam trainer, and top-k sampler.
GitHub repository with 51 stars and 0 forks.
Language: Python
Topics: attention, deep-learning, from-scratch, gpt, language-model, llm, machine-learning, numpy, python, transformer