LLMs

Using LLM products today feels a lot like using early cars in the 1800s: clearly magical, clearly going to change the world, and really hard to drive.

The first cars didn’t have steering wheels (they hadn’t been invented yet), so you’d steer them with a big lever called a tiller. The problem with tillers is that they are imprecise, which made... See more

Weird GPT token for Reddit user davidjl123, “a keen member of the /r/counting subreddit. He’s posted incremented numbers there well over 163,000 times. Presumably that subreddit ended up in the training data used to create the tokenizer used by GPT-2, and since that particular username showed up hundreds of thousands of times it ended up getting

... See more