scientific research
Danielle Vermeer and
scientific research
Through extensive experimentation across diverse puzzles, we show that frontier LRMs face a complete accuracy collapse beyond certain complexities. Moreover, they exhibit a counter-intuitive scaling limit: their reasoning effort increases with problem complexity up to a point, then declines despite having an adequate token budget. By comparing LRMs
... See moreParshin Shojaee • The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
“The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity.” They can’t think. Water is wet.
(1) New Working Paper: the fundamental driver of growth in modern economies, Total Factor Productivity (TFP), is linear, not exponential.
This is a paper I did not expect to write...
Thomas Philippontwitter.com
1. We asked students to test a specific hypothesis with a dataset: Is BMI related to number of steps? Other students were just asked to analyze the dataset.
The students with a specific hypothesis were 3X less likely to see the gorilla in the data! https://genomebiology.biomedcentral.com/articles/10.1186/s13059-020-02133-w…
/https%3A%2F%2Ftf-cmsv2-smithsonianmag-media.s3.amazonaws.com%2Ffiler_public%2F3c%2Fbe%2F3cbe5a70-e164-43cc-9d61-89d3f8b13891%2Fal-anode-mini-device-credit-p-bombelli-580x288px_1.jpg)