Generative AI
4 questions of organizations [about using AI].
- What did you do that was valuable that's no longer valuable?
- What impossible things can you now do that you could not before?
- What can you democratize and bring down market?
- What can you do upmarket so you have new ways of competing?
Ethan Mollick, https://www.forbes.com/sites/jenamcgregor/2024/
All three have different personalities and strengths, depending on whether you are coding or writing. Gemini is an excellent explainer but doesn’t let you upload files, GPT-4 has features (namely Code Interpreter and GPTs) that greatly extend what it can do, and Claude is the best writer and seems capable of surprising insight.
Ethan Mollick • Which AI should I use? Superpowers and the State of Play
Ethan Mollick’s comparison of the 3 main LLM models
One way to think about (LLM) is that about 3 years ago, aliens landed on Earth. They handed over a USB stick and then disappeared. Since then we’ve been poking the thing they gave us with a stick, trying to figure out what it does and how it works.
In a situation like this, there are two general pieces of advice one can give: keep your options open, and pay close attention to what's happening. Then if you can't predict the changes AI will cause, you'll at least be able to react quickly to them.
Paul Grahamx.comMeta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.
2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.
What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public dom
It is odd when folks get mad when I say AI is already useful. We are only 18 months into LLMs & there have already been many controlled trials finding LLMs are useful, firms have public case studies with real metrics, etc
Lots of reasons to critique AI, “uselessness” isn’t one.
Ethan Mollickx.comLearned something interesting from the CEO of a fairly big tech co. Usually 28 year olds are more productive programmers than 22 year olds, because they have more experience. But apparently 22 year olds are now as good as 28 year olds because they're more at ease using AI.
Paul Grahamx.comSkills you need in the age of AI: You’ll need critical thinking skills and emotional intelligence. Some technical skills e.g. understand the AI capabilities, some data literacy, cyber threats etc.
But mostly, you’ll need truly human soft skills:
- ability to make complex decisions
- ability to have creative problem solving
All skills that will enable
Weird GPT token for Reddit user davidjl123, “a keen member of the /r/counting subreddit. He’s posted incremented numbers there well over 163,000 times. Presumably that subreddit ended up in the training data used to create the tokenizer used by GPT-2, and since that particular username showed up hundreds of thousands of times it ended up getting it
... See more