Subsequent research by Gerstgrasser and colleagues at Stanford and MIT (arXiv:2404.01413) provides important qualification: model collapse is not inevitable if synthetic data accumulates alongside real data rather than replacing it. The pathological scenario assumes complete substitution—thoughtful data curation can prevent the worst outcomes.
The dream of course is that one day narrative jailbreaking works in an irl conversation too. So if we’re chatting and I ask you how your day has been and then ask you why you just manifested a portal to the reality onion-skinned just outside this one, right between us, hanging iridescent in the air, there look I’m reaching through it, what do I... See more
“Intelligence is the new transistor,” concluded Schiffmann. “It’s a fundamental primitive that you’ll build things on, [and it] will enable all kinds of good things and all kinds of bad things... The goal is just to enable the good over the bad.”