LLMs

All the Hard Stuff Nobody Talks About When Building Products With LLMs

LLMs are mid. It does a good job at getting the average and this is useful in many areas where this is tough. When you want "good", LLMs let you down. We underestimate the impact doing things to a "mid" level will have on the world.

Ian Vanagas

Meta AI released LLaMA ... and they included a paper which described exactly what it was trained on. It was 5TB of data.

2/3 of it was from Common Crawl. It had content from GitHub, Wikipedia, ArXiv, StackExchange and something called “Books”.

What’s Books? 4.5% of the training data was books. Part of this was Project Gutenberg, which is public

Johann Van Tonder

“A more practical answer is that it’s a file. This right here is a large language model, called Vicuna 7B. It’s a 4.2 gigabyte file on my computer. If you open the file, it’s just numbers. These things are giant binary blobs of numbers…”
Simon Willison, attempting to explain LLM

Johann Van Tonder

Large language models, explained with a minimum of math and jargon

Timothy B Lee understandingai.org

Darren LI and

One way to think about (LLM) is that about 3 years ago, aliens landed on Earth. They handed over a USB stick and then disappeared. Since then we’ve been poking the thing they gave us with a stick, trying to figure out what it does and how it works.

- Simon Williamson

Johann Van Tonder

LLMs bring new nature of abstraction

Martin Fowler martinfowler.com

Andrés

Do Prompt-Based Models Really Understand the Meaning of their Prompts?

Albert Webson arxiv.org

Isabelle Levent

#ai #llms #transformers #stanford #genai | Eduardo Ordax | 89 comments

linkedin.com

Andrés