AI
Matt Ross and
AI
Matt Ross and
Through extensive experimentation across diverse puzzles, we show that frontier LRMs face a complete accuracy collapse beyond certain complexities. Moreover, they exhibit a counter-intuitive scaling limit: their reasoning effort increases with problem complexity up to a point, then declines despite having an adequate token budget. By comparing LRMs
... See more“The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity.” They can’t think. Water is wet.
The irony is that I now know more than I ever would have before AI. But I feel slightly dumber. A bit more dull.
This whole post is very good. I don’t know whether Dustin is a canary or not, but he’s poking at some things I’ve been feeling to some degree.
Matt Webb continues to be one of my favorite writers over the last few years. His Poem/1 project was also amazing.
