LLMs
sari and
LLMs
People need to be more thoughtful building products on top of LLMs. The fact that they generate text is not the point.
thesephist.comstream.thesephist.comMeta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.
2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.
What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public
I've learned so much from @hubermanlab, but podcasts make recall and discovery challenging.
Huberman AI uses the latest models from @openai to search every episode with Google-level accuracy and summarize the results.
https://t.co/1nctiAIuGO https://t.co/VpjnY2NcpM
riley tomasektwitter.comPeople are intrigued by LLMs’ ability to generate new text, change styles, and generally chat. While impressive, turning text written in one style into text written in your own voice (or into legaleze) is essentially taking unstructured data and turning it into more unstructured data. I’m surprised about the lack of attention to doing the exact... See more
Matt Hartman • The power of AI is its ability to turn unstructured data into structured data
GitHub - transformerlab/transformerlab-app: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
github.com
There is so much more structure in the world than we tend to believe. And LLMs and other AI models are structure discovery machines.
Albert Wengerx.comUsing LLM products today feels a lot like using early cars in the 1800s: clearly magical, clearly going to change the world, and really hard to drive.
The first cars didn’t have steering wheels (they hadn’t been invented yet), so you’d steer them with a big lever called a tiller. The problem with tillers is that they are imprecise, which made... See more
The first cars didn’t have steering wheels (they hadn’t been invented yet), so you’d steer them with a big lever called a tiller. The problem with tillers is that they are imprecise, which made... See more