LLMs
sari and
LLMs
Weird GPT token for Reddit user davidjl123, “a keen member of the /r/counting subreddit. He’s posted incremented numbers there well over 163,000 times. Presumably that subreddit ended up in the training data used to create the tokenizer used by GPT-2, and since that particular username showed up hundreds of thousands of times it ended up getting
... See more
There’s a lot of hype around AI, and in particular, Large Language Models (LLMs). To be blunt, a lot of that hype is just some demo bullshit that would fall over the instant anyone tried to use it for a real task that their job depends on. The reality is far less glamorous: it’s hard to build a real product backed by an LLM .
Phillip Carter • All the Hard Stuff Nobody Talks About When Building Products With LLMs
People need to be more thoughtful building products on top of LLMs. The fact that they generate text is not the point.
thesephist.comstream.thesephist.com"A key challenge of (LLMs) is that they do not come with a manual! They come with a “Twitter influencer manual” instead, where lots of people online loudly boast about the things they can do with a very low accuracy rate, which is really frustrating..."
Simon Willison, attempting to explain LLM
There is so much more structure in the world than we tend to believe. And LLMs and other AI models are structure discovery machines.
Albert Wengerx.comLanguage models can take a big chunk of text and smush it down like a foot crushing a can of Coke. Except it doesn’t come out crushed—it comes out as a perfectly packaged and proportional mini-Coke. And it’s even drinkable! This is a Willy Wonka-esque magic trick, without the Oompa Loompas.
1/ AI exploded on the scene at the end of 2022, with applications like @OpenAI's ChatGPT taking the world by storm.
2023 is poised to be the most exciting year of AI yet! 🎉
Here's mine and @vivek7ue's look at the lay of the land + what might happen next...
👀🧵... See more