Stop Calling LLMs Stochastic Parrots. Compression Is Intelligence.
The most common critique of LLMs—that they’re just next-token predictors—is actually a testament to their intelligence. Information theory proves that optimal prediction requires optimal compression, which is a form of deep understanding. This article explains why compression is intelligence, and why the ‘stochastic parrot’ insult is a compliment.