NVIDIA Technical Blog | News and tutorials for developers, data ...

How do models represent style, and how can we more precisely extract and steer it?

A commonly requested feature in almost any LLM-based writing application is “I want the AI to respond in my style of writing,” or “I want the AI to adhere to this style guide.” Aside from costly and complicated multi-stage finetuning processes like Anthropic’s RL with... See more

To address these concerns, several of the leading model companies are working on improved steering —a way to place better controls on LLM outputs—to focus model outputs and help models better understand and execute on complex user demands.

Today most algorithms that recommend or suppress content act purely on the basis of inferred popularity. They look at how much time people spend engaging with a piece of content, and boost it to more people if the numbers look good. The content itself is almost purely a black box. Some algorithms try to classify content with tags like “food” or “fu

... See more