ai
They're mostly doing "manifold filling" at the moment - filling in the interpolation gaps between what humans already know, somehow treating knowledge as an intangible fabric of reality.
Thomas Wolf • 🔭 The Einstein AI model
connecting dots in the latent space of human knowledge
klasyczny Dwarkesh: tj. czy jak damy modelowi całą wiedzę o fizyce do Einsteina, ale ani kroku dalej, czy wymyśli teorię względności?
To create an Einstein in a data center, we don't just need a system that knows all the answers, but rather one that can ask questions nobody else has thought of or dared to ask. One that writes 'What if everyone is wrong about this?' when all textbooks, experts, and common knowledge suggest otherwise.
Thomas Wolf • 🔭 The Einstein AI model
czy ja potrafię tak zadawać pytania? raczej nie. albo momentami, w pojedynczych sytuacjach, jak np. u filomatów na interview
I believe an Einstein-level breakthrough in Go would involve something more fundamental, like inventing the rules of Go itself—exploring the vast landscape of possible game rules to create something genuinely more compelling than existing games.
Thomas Wolf • 🔭 The Einstein AI model
think: the glass bead game, inveting the rules of the game of the human culture itself; move 37 in go is not an Einstein level breakthrough
LeCun points to four essential characteristics of human intelligence that current AI systems, including LLMs, can’t replicate: reasoning, planning, persistent memory, and understanding the physical world. He stresses that LLMs’ reliance on textual data severely limits their understanding of reality: “We’re easily fooled into thinking they are intel... See more
Azeem Azhar • 🧠 AI’s $100bn question: The scaling ceiling
People will desperately want rapid AI progress to slow down once it hits them hard. I’ve written extensively about labor market impacts before, but that’s not all there is on backlash: A lot of the deployment avenues for tomorrow’s frontier systems will feel fundamentally alien and scary to people. They’ll see automated systems doing things they th... See more
This perspective misses the most crucial aspect of science: the skill to ask the right questions and to challenge even what one has learned. A real science breakthrough is Copernicus proposing, against all the knowledge of his days -in ML terms we would say “despite all his training dataset”-, that the earth may orbit the sun rather than the other ... See more
Thomas Wolf • 🔭 The Einstein AI model
istota nauki
This all goes back to Ilya’s provocation for why next-token prediction is enough on the Dwarkesh Podcast:
Predicting the next token well means that you understand the underlying reality that led to the creation of that token.