Saved by Packy McCormick and
The Bitter Lesson
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as... See more
incompleteideas.net • The Bitter Lesson
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin.
hyperthesis • The Bitter Lesson
The methods need to require more computational resources rather than particularly clever encodings of human specialist knowledge. Resources can be time (to run computer microcode instructions) or space (memory to hold data).
We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long... See more
incompleteideas.net • The Bitter Lesson
Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research.