Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs
Summary
PrismML announces 1-bit Bonsai, a family of LLMs with 1-bit weights that run on-device with drastically reduced memory and energy use. The 8B, 4B, and 1.7B variants claim substantial speedups and competitive benchmarks, enabling on-device inference for edge devices and smartphones. The launch underscores a shift toward efficiency-focused AI deployment for edge, robotics, and privacy-sensitive applications.