ai
1*bvMhd_xpVxfJYoKXYp5hug.png (2208×1244)
miro.medium.com
Yann LeCun’s cake on the RL, Supervised & Self-Supervised Learning
Although we now have models that can generate remarkably realistic video based on user requests, if we want models that solve complex problems, perform intricate reasoning, and make subtle inferences, language models are still the main and only option. We can’t ask Veo 3 to estimate whether the island of Hawaii contains more cubic meters of rock th... See more
Language Models in Plato's Cave
People will desperately want rapid AI progress to slow down once it hits them hard. I’ve written extensively about labor market impacts before, but that’s not all there is on backlash: A lot of the deployment avenues for tomorrow’s frontier systems will feel fundamentally alien and scary to people. They’ll see automated systems doing things they th... See more
In that compute-constrained world, deployment and development trade off directly. That starts as a lab-internal effect, where deployment and product improvements eat into (compute) resources otherwise earmarked for development.
hard cap on what can be done & recursive self improvement not necessarily happening this decade
I come to the same realization: in the context of AI, what I’m doing is a waste of time. It’s horrifying. The fun has been sucked out of the process of creation because nothing I make organically can compete with what AI already produces—or soon will.
Dustin Curtis on Svbtle • Thoughts on Thinking
on condition that all you do is interpolations in the latent space of human knowledge, and AI not only will be able to, but will - make such interporlations.
I believe an Einstein-level breakthrough in Go would involve something more fundamental, like inventing the rules of Go itself—exploring the vast landscape of possible game rules to create something genuinely more compelling than existing games.
Thomas Wolf • 🔭 The Einstein AI model
think: the glass bead game, inveting the rules of the game of the human culture itself; move 37 in go is not an Einstein level breakthrough
They're mostly doing "manifold filling" at the moment - filling in the interpolation gaps between what humans already know, somehow treating knowledge as an intangible fabric of reality.
Thomas Wolf • 🔭 The Einstein AI model
connecting dots in the latent space of human knowledge