Squirrel Squadron Substack • 3 implied HN points • 04 Feb 26
- Lossless compression makes files smaller without losing any detail by exploiting redundancy, while lossy compression sacrifices quality for size. Trying to compress already compressed or random data usually fails and can even make files bigger.
- There are theoretical limits to how much you can compress—concepts like Kolmogorov complexity measure the shortest description of data—so texts with more genuine information are inherently harder to shrink.
- Modern large language models act like powerful compression engines: by predicting the next token they build compact internal models of huge datasets, and that predictive ability correlates with intelligent performance. You can already use these models as practical assistants to boost productivity rather than waiting for some distant breakthrough.