Compression is prediction
Summary
This NGrok blog post explains how data compression is fundamentally about prediction. It covers classic methods like run-length encoding, Huffman coding, and arithmetic coding, then connects these concepts to LLMs and context modeling, highlighting how better predictors improve compression and the trade-offs of using large models for practical tasks.