Generative AI
LLMs combine what they “learned” in training with any new context you give them. There are many ways to give the AI additional context, the most common is in the prompt that you provide (“You should act like a marketer and help me respond to a request for proposal”), or any documents you upload to the AI.
Ethan Mollick • Which AI should I use? Superpowers and the State of Play
All three have different personalities and strengths, depending on whether you are coding or writing. Gemini is an excellent explainer but doesn’t let you upload files, GPT-4 has features (namely Code Interpreter and GPTs) that greatly extend what it can do, and Claude is the best writer and seems capable of surprising insight.
Ethan Mollick • Which AI should I use? Superpowers and the State of Play
Ethan Mollick’s comparison of the 3 main LLM models
“A more practical answer is that it’s a file. This right here is a large language model, called Vicuna 7B. It’s a 4.2 gigabyte file on my computer. If you open the file, it’s just numbers. These things are giant binary blobs of numbers…”
Simon Willison, attempting to explain LLM
Weird GPT token for Reddit user davidjl123, “a keen member of the /r/counting subreddit. He’s posted incremented numbers there well over 163,000 times. Presumably that subreddit ended up in the training data used to create the tokenizer used by GPT-2, and since that particular username showed up hundreds of thousands of times it ended up getting it
... See more
The integration-automation framework differentiates between 4 use case types:
- Assistants
- Copilots
- Autopilots
- Agents
See full breakdown: https://blog.tobiaszwingmann.com/p/integration-automation-ai-framework
Meta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.
2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.
What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public dom
you haven’t really experienced AI until you have had three sleepless nights of existential anxiety, after which you can start to be productive again
Ethan Mollick • Which AI should I use? Superpowers and the State of Play
“We don’t know what capabilities GPT-5 will have until we train it and test it. It might be a medium-size problem right now, but it will become a really big problem in the future as models become more powerful.”
"A key challenge of (LLMs) is that they do not come with a manual! They come with a “Twitter influencer manual” instead, where lots of people online loudly boast about the things they can do with a very low accuracy rate, which is really frustrating..."
Simon Willison, attempting to explain LLM