AI

For example, if you ask a model to “return all active users in the last 7 days” it might hallucinate a `is_active` column, join to an `activity` table that doesn’t exist, or potentially get the wrong date (especially in leap years!).

We previously talked to Shreya Rajpal at Guardrails AI, which also supports Text2SQL enforcement. Their approach was... See more

When you hear a phrase like a “7B parameter model,” 7 billion parameters is a measure of the dataset, not the model . You obviously couldn’t train such a model out of, say, a text of 50 words (well you could, but it would be highly informationally degenerate). And if you gave the training protocol 100 internets worth of data, 7B parameters may not... See more

The writing is getting better. The ideas are getting worse. There’s a new genre of essay that other academics reading this will instantly recognize, a clumsy collaboration between students and Silicon Valley. I call it glittering sludge .

Tyler Cowen and Gwern have both seen it. 'But who reviews it? Is TLS going to pick it up? It doesn't matter anymore.'