AI
The most interesting part for me is where @karpathy describes why LLMs aren't able to learn like humans.
As you would expect, he comes up with a wonderfully evocative phrase to describe RL: “sucking supervision bits through a straw.”
A single end reward gets broadcast across every token in... See more
Dwarkesh Patelx.comKarphaty on LLMs
Google's vibe-coding tool Opal comes to Gemini | TechCrunch
techcrunch.com
Google Opal lets you build mini apps. Now it will be available straight from Gemini
Mozilla’s new CEO is doubling down on an AI future for Firefox
theverge.com
Probably not what their core users want
AI image generators are getting better by getting worse
theverge.com
AI generated images and the future
Differences between AI and human learning, focusing on batch training, lack of continual learning, and catastrophic forgetting in AI.
TRANSCRIPT
So mechanically, there seems to clearly be something different, or at least there's a big community of people in the computational neuroscience community that agree that there's got to be something different going on between these systems.
More abstractly, though, what's fundamentally different, which I think is maybe more practically
... See more