The Next Token of Progress: 4 Unlocks on the Generative AI Horizon

Key unlock: LLMs will be able to take into account vast amounts of relevant information and offer more personalized, tailored, and useful outputs.

These conversations identified 4 key innovations on the horizon: steering, memory, “arms and legs,” and multimodality.

Key unlock: Multimodal models can reason about images, video, or even physical environments without significant tailoring.

Key unlock: users can better tailor the outputs of LLMs.

Key unlock: LLMs will be able to interact much more effectively with the tools we use today.

To address these concerns, several of the leading model companies are working on improved steering —a way to place better controls on LLM outputs—to focus model outputs and help models better understand and execute on complex user demands.