AI

The more I use language models, the more monstrous they seem to me. I don’t mean that in a partic­u­larly negative sense. Frankenstein’s monster is sad, but also amazing. Godzilla is a monster, and Godzilla rules.

We humans aren't the only ones to experience cognitive decline as we age. Research conducted by neurologists and data scientists reveals that some artificial intelligence models struggle with visual, spatial, and executive tasks as they get older, suggesting that they, too, age away from peak performance. The study highlights an unanticipated... See more

When you hear a phrase like a “7B parameter model,” 7 billion parameters is a measure of the dataset, not the model . You obviously couldn’t train such a model out of, say, a text of 50 words (well you could, but it would be highly informationally degenerate). And if you gave the training protocol 100 internets worth of data, 7B parameters may not... See more