LLMs
sari and
LLMs
Language models can take a big chunk of text and smush it down like a foot crushing a can of Coke. Except it doesn’t come out crushed—it comes out as a perfectly packaged and proportional mini-Coke. And it’s even drinkable! This is a Willy Wonka-esque magic trick, without the Oompa Loompas.
People are intrigued by LLMs’ ability to generate new text, change styles, and generally chat. While impressive, turning text written in one style into text written in your own voice (or into legaleze) is essentially taking unstructured data and turning it into more unstructured data. I’m surprised about the lack of attention to doing the exact... See more
Matt Hartman • The power of AI is its ability to turn unstructured data into structured data
1/ AI exploded on the scene at the end of 2022, with applications like @OpenAI's ChatGPT taking the world by storm.
2023 is poised to be the most exciting year of AI yet! 🎉
Here's mine and @vivek7ue's look at the lay of the land + what might happen next...
👀🧵... See more
Embeddings: What they are and why they matter
simonwillison.net
Using LLM products today feels a lot like using early cars in the 1800s: clearly magical, clearly going to change the world, and really hard to drive.
The first cars didn’t have steering wheels (they hadn’t been invented yet), so you’d steer them with a big lever called a tiller. The problem with tillers is that they are imprecise, which made... See more
The first cars didn’t have steering wheels (they hadn’t been invented yet), so you’d steer them with a big lever called a tiller. The problem with tillers is that they are imprecise, which made... See more
“The fact that these things model language is probably one of the biggest discoveries in history. That you (LLM) can learn language by just predicting the next word … — that’s just shocking to me.”
- Mikhail Belkin, computer scientist at the University of California
There’s a lot of hype around AI, and in particular, Large Language Models (LLMs). To be blunt, a lot of that hype is just some demo bullshit that would fall over the instant anyone tried to use it for a real task that their job depends on. The reality is far less glamorous: it’s hard to build a real product backed by an LLM .