So right now, LLMs (Large Language Models) are all the rage. But in the future, it’s possible that the way we get things done is composing things with a combination of LLMs, SMMs (Small, Mighty Models), agents and tools.
It’s what I call Cognitive Composition (because it sounds cool and I have a longtime love affair with alliteration).
Content Credentials will become a flex of a creator’s humanity, a media outlet’s credibility, an artist’s attribution, and a story’s transparency. Right now, the focus of Content Credentials is around authenticity and determining whether you can trust what you’re looking at. Of course, the existence of credentials will never guarantee that the... See more
Disruptive innovation comes in two flavors: (1) New-market disruption, where the company creates and claims a new segment in an existing market by catering to an underserved customer base, or (2) Low-end disruption, in which a company uses a low-cost business model to enter at the bottom of an existing market and claim a segment.
How do models represent style, and how can we more precisely extract and steer it?
A commonly requested feature in almost any LLM-based writing application is “I want the AI to respond in my style of writing,” or “I want the AI to adhere to this style guide.” Aside from costly and complicated multi-stage finetuning processes like Anthropic’s RL with... See more
I’ve been giving talks and speaking with engineers and non-technical audiences about interpretability since 2022, and I still struggle to explain exactly what a “feature” is. I often use words like “concept” or “style”, or establish metaphors to debugging programs or making fMRI scans of brains. Both metaphors help people outside of the subfield... See more
Interface > Data > Model: The “interface” and “data” layers will further distinguish market leaders while the “models” layer becomes increasingly commoditized and pushed to the edge. As a growing number of our everyday use-cases of powerful GenerativeAI models fall below the frontier of “the best models,” they will be enabled by cheaper... See more