Sublime
An inspiration engine for ideas
Why isn't everyone just using Kimi K2 on @GroqInc for codegen?
Sure, it's only 90% as good as sonnet. But it's like 3x+ faster and 5x+ cheaper. Run it twice and you're ahead.
This is the future: use validation, embrace failure, and run quick/cheap until success.
Jamie Turnerx.com
With Sonnet 3.7, Anthropic has clearly placed the focus on coding. Other areas were apparently not particularly important to them.
Incremental improvements in MMLU and GPQA, but a giant leap in SWE. It is clear that Anthropic wants to position Sonnet as the coding AI that it already is.
Love this project: nanoGPT -> recursive self-improvement benchmark. Good old nanoGPT keeps on giving and surprising :)
- First I wrote it as a small little repo to teach people the basics of training GPTs.
- Then it became a target and baseline for my port to direct C/CUDA re-implementation in... See more
Andrej Karpathyx.com"Gradient descent is a better programmer than you." - @karpathy (approximately...)
Michael Nielsenx.com
Since prompting, instruction tuning, RLHF, ChatGPT etc are such new and fast-moving topics, I haven't seen many university course lectures covering this content.
So we made some new slides for this year's CS224n: NLP w/ Deep Learning course at @Stanford!
https://t.co/TwSgCr63QA... See more
Jeff Dean and Noam Shazeer are among the godfathers of modern AI at Google. Most interesting ideas from the recent Dwarkesh podcast:
1. If AI can automate chip design and a "million automated researchers" can generate novel model architectures, AI development might continue to accelerate... See more
Deedyx.com