ModelsText is the most advanced domain. However, natural language is hard to get right, and quality matters. Today, the models are decently good at generic short/medium-form writing (but even so, they are typically used for iteration or first drafts). Over time, as the models get better, we should expect to see higher quality outputs, longer-form... See more

Generative AI’s first

year out the gate—“Act 1”—came from the

technology-out

. We discovered a new “hammer”—foundation models—and unleashed a wave of novelty apps that were lightweight demonstrations of cool new technology.

We now believe

the market is entering “Act 2”—which will be from the

customer-back

. Act 2 will solve human problems end-to-end.... See more

We can decompose the progress in the four years from GPT-2 to GPT-4 into three categories of scaleups:

1. Compute : We’re using much bigger computers to train these models.


2. Algorithmic efficiencies : There’s a continuous trend of algorithmic progress. Many of these act as “compute multipliers,” and we can put them on a unified scale of growing

... See more