LLMs
sari and
LLMs
Thoughts on AI
linkedin.com
Meta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.
2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.
What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public
There is so much more structure in the world than we tend to believe. And LLMs and other AI models are structure discovery machines.
Albert Wengerx.comOpenAI vs. Anthropic vs. Cohere
sacra.com
1/ AI exploded on the scene at the end of 2022, with applications like @OpenAI's ChatGPT taking the world by storm.
2023 is poised to be the most exciting year of AI yet! 🎉
Here's mine and @vivek7ue's look at the lay of the land + what might happen next...
👀🧵... See more