Float Bloat: vector serialization gone wrong
Summary
Bonsai identifies a pervasive issue called Float Bloat where vector embeddings serialized as float64 inflate storage and network costs without improving accuracy. The article provides examples across languages, explains why widening happens during serialization, and outlines fixes to serialize at float32 precision or use binary formats to reduce overhead, with a claimed global impact of tens of petabytes.