PrismML Releases Bonsai 27B: 1-bit and Ternary Builds of Qwen3.6-27B That Run on Laptops and Phones
- PrismML dropped Bonsai 27B, compressing Qwen3.6 into 1-bit and ternary weights. It’s not a new pretrain; it’s just Qwen stripped down to its bones. The 1-bit version fits on a phone at 3.9GB, retaining 89.5% accuracy. The ternary build sits at 5.9GB with 94.6% retention. This is the AI equivalent of eating only the meat off the bone and leaving the gristle. For the moonboys who think their laptop can’t handle local inference, this is your salvation. No more bloated models requiring a data center to run a chatbot. Just raw, quantized efficiency. If you’re still running FP16 in 3001, you’re wasting hash power. Get with the compression or get left behind.