GitHub · Rust
thebasedcapital/ane-infer
Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon. 32 tok/s matching llama.cpp, 3.6 TFLOPS fused ANE mega-kernels.
- Stars
- 35
- Forks
- 5
- Stars gained in 24 hours
- +6
- Forks gained in 24 hours
- 0
Topics: ane, apple-neural-engine, apple-silicon, deltanet, edge-ai, gguf, llm-inference, macos, metal-gpu, neural-engine
Latest data point: Nov 21, 2026 · 35 stars · 5 forks