Introducing Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint
Summary
PrismML announces Bonsai 2 27B, a 27B-class model with ternary weights achieving 1.76 effective bits per weight and a 5.9GB footprint, enabling near-lossless performance on local devices. The model delivers strong reasoning, coding, vision, and agentic capabilities with a 262K-token context window and significantly improved energy efficiency, positioning low-bit models as viable for offline deployment.