therezor/cardputer-ai
Fully offline tiny LLM chatbot on the ESP32-S3 Cardputer ADV - 3M params, Q4 weights baked into the firmware, ~7 tok/s.
GitHub repository with 27 stars and 3 forks.
Language: C++
Topics: ai, ai-chat, cardputer, cardputer-adv, local-ai, local-llm