Replacing a 3 GB SQLite database with a 10 MB FST (finite state transducer) binary
Summary
The post documents replacing a 3 GB SQLite database used for a Finnish-English dictionary with a 10 MB FST-based binary, achieving a ~300x memory reduction. It explains the shift from a trie-based in-RAM data structure to a static Rust/FST solution and discusses the trade-offs and implications for search performance and memory usage. It also references Rust, the fst crate, and related tooling.