• What a modern LLM does during training is, essentially, very very quickly skim the textbook, the words just flying by , not spending much brain power on it.


• Rather, when you or I read that math textbook, we read a couple pages slowly; then have an internal monologue about the material in our heads and talk about it with a few study-buddies; read

... See more

Prompting Unlocks Theory-of-Mind in LLMs Zero-shot theory-of-mind accuracy: -GPT-4: 80% -Humans: 87% Prompting in-context learning (few-shot / chain-of-thought reasoning): -All RLHF-trained LLMs: 80%+ -GPT-4:... See more