🧠AI’s $100bn question: The scaling ceiling
Ilya Sutskever, perhaps the most influential proponent of the AI "scaling hypothesis," just told Reuters that scaling has plateaued. This is a big deal! This comes on the heels of a big report that OpenAI's in-development Orion model had disappointing results. 🧵 https://t.co/DiRb9sOHt8
First with DallE, it was artists. Now with Devin, coders. We never thought it would happen, but it was obvious in hindsight.
It reminds me of The Bitter Lesson by Richard Sutton, where he makes the case that betting on the scaling of computational power is the winning formula.
We more or... See more
Silen Naihinx.comCan we predict the future capabilities of AI? .
@ilyasut, co-founder and chief scientist of OpenAI, on the scaling law and an interesting area of research:
(1) The scaling law relates the input of the neural network to simple-to-evaluate performance measures like next-word prediction... See more
Alex Ker ðŸ”x.com