Can gzip be a language model?
- Sources: primary, discussion
- Summary: The post builds a language model that scores candidate continuations by DEFLATE compressed length and runs a beam search over them. The implementation is a single file using only the Python standard library.
- Why it matters: The compression and prediction equivalence becomes something an engineer can run and step through in an afternoon rather than read about.