Hall of FameRich Sutton20195 min readintro
The Bitter Lesson
Summary
Rich Sutton’s essay argues that over the past 70 years AI progress has consistently come from methods that can scale with more computation—search and learning—while hand‑crafted, human‑knowledge approaches give only short‑term gains. The piece uses chess, Go, speech and vision as case studies to warn researchers to favor general, compute‑driven techniques.
- Methods that scale with computation (search, learning) consistently outpace domain‑specific, human‑knowledge approaches.
- Chess, Go, speech recognition, and vision all shifted from hand‑crafted techniques to compute‑heavy search or deep learning.
- Human knowledge yields short‑term gains but plateaus; increasing compute drives continued progress.
- Prioritize architectures that can leverage more compute rather than embedding task‑specific priors.
AI researchers and engineers should read it to avoid over‑investing in domain‑specific tricks and instead build systems that benefit from scaling compute.
7/10
