Marcus on AI • 2648 implied HN points • 24 Nov 24
- Scaling laws in AI aren't as reliable as people once thought. They're more like general ideas that can change, rather than hard rules.
- The new approach to scaling, which focuses on how long you train a model, can be costly and doesn't always work better for all problems.
- Instead of just trying to make existing models bigger or longer-lasting, the field needs fresh ideas and innovations to improve AI.