
🧠AI’s $100bn question: The scaling ceiling

It’s an empirical question whether we will hit a brick wall. No one knows. In the meantime, we should also double down on innovation. You
Dwarkesh Patel • The Scaling Era: An Oral History of AI, 2019–2025
Quote: "Ilya Sutskever, co-founder of AI labs Safe Superintelligence (SSI) and OpenAI, told Reuters recently that results from scaling up pre-training - the phase of training an AI model that uses a vast amount of unlabeled data to understand language patterns and structures - have plateaued." .... See more
Yann LeCun (@yannlecun)
don’t want people to come away thinking that models aren’t going to get much better. The jumps we’ve seen so far are huge. Even if those continue on a smaller scale, we’re still in for extremely smart, very reliable agents over the next couple of orders of magnitude. We have a lot more jumps coming. Even if those jumps are smaller, relatively speak
... See moreDwarkesh Patel • The Scaling Era: An Oral History of AI, 2019–2025
The speed at which things are adapting is accelerating. Everyone can feel this, but not everyone is able to put their finger on HOW they should respond to it. The pitfall I see is that many old-school thinkers are ignoring the speed at which things are changing with the excuse of “this time isn’t different.” On the other side of the spectrum, you h
... See moreCapital Flows • AI & the New Age of Learning
