This is fascinating: Rich Sutton on the "bitter lesson" of AI research: https://t.co/LW5TOGTIKw https://t.co/z4nsRbH01V

An AI Thought Experiment

• What a modern LLM does during training is, essentially, very very quickly skim the textbook, the words just flying by , not spending much brain power on it.


• Rather, when you or I read that math textbook, we read a couple pages slowly; then have an internal monologue about the material in our heads and talk about it with a few study-buddies; read

... See more