LLMs
sari and
LLMs
Meta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.
2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.
What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public dom
Thoughts on AI
linkedin.com
Meanwhile, LLM results are probabilistic. 10 blue links are also probabilistic, but Google is giving you options - adding human curation by making you pick from a list of results. Using an LLM result is more like hitting ‘I’m feeling lucky’ - it requires more confidence
March 2023 AI Overview for Boards
docs.google.comnice overview of why every company needs an AI strategy
