In ordinary language, we frequently speak of machinery or ideas ‘doing’ things in our lives. But they do nothing. People – human persons – produce, operate and apply their creations. The problem with assigning agency, even informally, to the nonhuman is that this disguises the strength of human control, limited though it is in other respects. It... See more
Observing these patterns of influence gives clues about how our models generalize from their training data. For instance, if the models responded to user prompts by splicing together sequences from the training set, then we’d expect the influential sequences for a given model response to include expressions of near-identical thoughts. Conversely,... See more
Memorization vs learning concepts and forming models of the world.
Lawsuits from major publishers against Suno and Udio are not, as libertarian boosters, VCs and Tech Bros would say, an attack on innovation. They are a warning shot against a business model that turns creative labor into raw machine fuel under the pretense of fair use.
AI augmentation is a future requirement, but remain mindful of what’s outsourced. Going forward, we need more demanding journeys than we do mindless shortcuts. Shortcuts rarely yield fun, stories or lessons. If it's easy, it likely isn’t worthwhile.
“We realized rasterization was reaching its limits,” he said, referring to the traditional, widely used method of rendering a 3D scene. “2018 was a ‘bet the company’ moment. It required that we reinvent the hardware, the software, the algorithms. And while we were reinventing CG with AI, we were reinventing the GPU for AI.”
The dream of course is that one day narrative jailbreaking works in an irl conversation too. So if we’re chatting and I ask you how your day has been and then ask you why you just manifested a portal to the reality onion-skinned just outside this one, right between us, hanging iridescent in the air, there look I’m reaching through it, what do I... See more