AI
Matt Ross and
AI
When you hear a phrase like a “7B parameter model,” 7 billion parameters is a measure of the dataset, not the model . You obviously couldn’t train such a model out of, say, a text of 50 words (well you could, but it would be highly informationally degenerate). And if you gave the training protocol 100 internets worth of data, 7B parameters may not... See more
Venkatesh Rao • A Camera, Not an Engine
Excellent explanation of how the transforms work
Superintelligence by Nick Bostrom, Professor in the Faculty of Philosophy & Oxford Martin School and Director & Future of Humanity Institute & University of Oxford
t on LLMs and SQL highlighting why they don’t consistently work :
- “LLMs can write SQL, but they are often prone to making up tables, making up field”
- “LLMs have some context window which limits the amount of text they can operate over”
- “The SQL it writes may be incorrect for whatever reason, or it could be correct but just return an unexpected
Artyom Keydunov • Powering your Copilot for Data – with Artem Keydunov of Cube.dev
KEKE is fascinating.
The writing is getting better. The ideas are getting worse. There’s a new genre of essay that other academics reading this will instantly recognize, a clumsy collaboration between students and Silicon Valley. I call it glittering sludge .
Brian Klaas • The Death of the Student Essay—and the Future of Cognition
By 2030, we’ll see 92 million jobs lost, and 𝟏𝟕𝟎 𝐦𝐢𝐥𝐥𝐢𝐨𝐧 jobs created, according to the latest WEF report. | Alex Wang
Alex Wanglinkedin.com
The irony is that I now know more than I ever would have before AI. But I feel slightly dumber. A bit more dull.
Dustin Curtis on Svbtle • Thoughts on Thinking
This whole post is very good. I don’t know whether Dustin is a canary or not, but he’s poking at some things I’ve been feeling to some degree.