Microgpt in pure C hits 10M tps on Apple m5
Summary
MicroGPT-C is a pure-C, dependency-free GPT-like model with 4192 parameters. The article reports high throughput benchmarks (10,168,430 tok/sec on Apple M5 Pro NEON) and explains training/inference separation in a single C file. It highlights the open-source nature and potential for ultra-lightweight AI in embedded or resource-constrained environments.