LLMs
sari and
LLMs
GitHub - transformerlab/transformerlab-app: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
github.com
Artificial Intelligence
Timothy Shih and • 243 cards
"the best use case of LLMs is bullshit"
Meta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.
2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.
What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public
NFX’s Generative Tech Open Source Market Map
docs.google.comLLMs are mid. It does a good job at getting the average and this is useful in many areas where this is tough. When you want "good", LLMs let you down. We underestimate the impact doing things to a "mid" level will have on the world.