from-scratch repositories
Trending repositories tagged from-scratch, ranked by trending score. Updated daily.
-
1
rohitg00/ai-engineering-from-scratch
Learn AI Engineering! Learn it. Build it. Ship it for others.
GitHub · Python · 79,644 stars · 14,232 forks · +312 stars in 24 hours · Trending score 4.88
-
2
FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
GitHub · C · 12,485 stars · 1,932 forks · +181 stars in 24 hours · Trending score 4.37
-
3
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
GitHub · Jupyter Notebook · 108,691 stars · 16,815 forks · +100 stars in 24 hours · Trending score 3.93
-
4
logitcai/tinybrain
A Chinese-first small language model built from scratch: open 60B-token dataset, tokenizer, mHC + Engram + MoE model, pretraining through RL, all in PyTorch. 从零做中文小模型,数据和代码全部开源
GitHub · Python · 252 stars · 9 forks · +232 stars in 24 hours · Trending score 2.95
-
5
aa1143/NamiAgent
零基础入门 AI Agent 的基础教程。不只是教程,也是一个能在本地跑起来的 Agent:读写文件、执行命令、MCP、长期记忆,自带网页端看清每一步。从 100 行最小循环开始,一课加一个能力,最后拆解 Claude Code、Codex 等主流 Agent
GitHub · Python · 577 stars · 59 forks · +34 stars in 24 hours · Trending score 2.72
-
6
aa1143/NamiGPT
零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step
GitHub · Python · 258 stars · 25 forks · +14 stars in 24 hours · Trending score 2.06
-
7
TrenTorch/TrenTorch
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
GitHub · Python · 861 stars · 87 forks · +6 stars in 24 hours · Trending score 1.60
-
8
fancyboi999/ai-engineering-from-scratch-zh
Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南
GitHub · Python · 1,341 stars · 196 forks · 0 stars in 24 hours · Trending score 0.72
-
9
hafizradzi8901/bitnet-rwkv-lm
From-scratch 0.15B BitNet 1.58-bit (ternary) RWKV-7 LLM trained on an 8GB GPU — QAT, 2-bit packing, RFT, local chat app.
GitHub · Python · 10 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46
-
10
pablo-reyes8/deepseek-v4-mini-pytorch
From-scratch, paper-faithful PyTorch implementation of DeepSeek-V4 architecture for transparent study, testing, ablation, and mini-scale training.
GitHub · Python · 13 stars · 1 forks · 0 stars in 24 hours · Trending score 0.46
-
11
navthings/airgpt
train your own chatbot from scratch on a mac
GitHub · Python · 26 stars · 1 forks · +1 stars in 24 hours · Trending score 0.45
-
12
lucid-softworks/browser
A web browser written from scratch — a platform-agnostic Rust engine (networking, HTML/CSS parsing, DOM, style, layout, paint) with a thin native app shell per OS.
GitHub · Rust · 132 stars · 8 forks · 0 stars in 24 hours · Trending score 0.43
-
13
dev-luigi/neural-network-digits
Neural network from scratch in pure Python + NumPy that recognises handwritten digits (MNIST), with an educational GUI: watch it learn, tweak it while it trains, look inside every layer.
GitHub · Python · 43 stars · 1 forks · 0 stars in 24 hours · Trending score 0.36
-
14
cognisoc/zigllm
Learn how LLMs work by building one in Zig -- from tensors to text generation.
GitHub · Zig · 12 stars · 1 forks · 0 stars in 24 hours · Trending score 0.24
-
15
artemtsitronov/hobby-os
A simple attempt to create an OS. Mostly to learn OSDev and as a challenge to use minimal AI
GitHub · Rust · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14
-
16
dosty340-max/lumen-os-2
A phone OS written from scratch by Claude: Slab UI, own compositor, DHCP/DNS/HTTP stack, HTML/CSS browser and a YouTube player. Runs in QEMU on Apple Silicon.
GitHub · C · 13 stars · 12 forks · 0 stars in 24 hours · Trending score 0.10
-
17
12hrformat/copperlinux
Copper Linux is a Linux distro made for daily-driving for coders, students or just people who like distro hopping. Its development was started in 21st of September, the leader is 12hrformat. Do check out Deadlight Linux too!
GitHub · Shell · 6 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08
-
18
Awesome-Embedded-Learning-Studio/Cinux
Cinux, C/C++'s version of X64 Operating System, using modern feature in C/C++!
GitHub · C++ · 44 stars · 9 forks · 0 stars in 24 hours · Trending score 0.08
-
19
lavishguptaa/llm-architecture-atlas
An open-source collection covering almost all major LLM architectures, built to explore, understand, and implement the building blocks of modern language models.
GitHub · Python · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07
-
20
Amey-Thakur/AI-ENGINEERING
Learn to build AI systems by building them. From nothing installed to shipping. No account, no API key, no GPU, no dependencies: every lesson runs offline on the Python standard library.
GitHub · Python · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.05
-
21
vaneeckhoutnicolas/quantum-cortex
A 27M parameter byte level language model with a memory outside its weights: a sealed journal of episodes it must cite or abstain from. Every claim has a row, a file and a test that can fail.
GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04
-
22
Exorust/TorchLeet
LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.
GitHub · Jupyter Notebook · 2,621 stars · 327 forks · 0 stars in 24 hours · Trending score 0.00
-
23
sagi21805/LearnixOS
An OS which is all about learning!
GitHub · Rust · 297 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00
-
24
raiyanyahya/how-to-train-your-gpt
Build a modern LLM from scratch. Every line commented. Explained like we are five.
GitHub · Jupyter Notebook · 4,142 stars · 503 forks · 0 stars in 24 hours · Trending score 0.00