Saved by Darren LI and
The Next Token of Progress: 4 Unlocks on the Generative AI Horizon
ModelsText is the most advanced domain. However, natural language is hard to get right, and quality matters. Today, the models are decently good at generic short/medium-form writing (but even so, they are typically used for iteration or first drafts). Over time, as the models get better, we should expect to see higher quality outputs, longer-form... See more
Pat Grady • Generative AI: A Creative New World
We can decompose the progress in the four years from GPT-2 to GPT-4 into three categories of scaleups:
- Compute : We’re using much bigger computers to train these models.
- Algorithmic efficiencies : There’s a continuous trend of algorithmic progress. Many of these act as “compute multipliers,” and we can put them on a unified scale of growing
SITUATIONAL AWARENESS - The Decade Ahead • I. From GPT-4 to AGI: Counting the OOMs
The explosion of generative AI made us pause and consider what was possible now that wasn’t a year ago. We tried many ideas which didn’t really click, eventually discovering the power of turning every feed and job posting into a springboard to:
- Get information faster , e.g. takeaways from a post or learn about the latest from a company.
- Connect the