John Mayo-Smith's Substack • 2 HN points • 22 Feb 24
- Transforming words using matrices in language models is similar to transforming objects in games.
- Context is crucial in language understanding like camera view settings are in games.
- Adding nuance to language is akin to adding texture to 3D models in games.