AI-powered document editors, then, among other tools, use all that training data to make it even easier to write outcome-oriented garbage that moves us further and further from the truth of ourselves and each other as beautiful, complex, experiencing beings.
Observing these patterns of influence gives clues about how our models generalize from their training data. For instance, if the models responded to user prompts by splicing together sequences from the training set, then we’d expect the influential sequences for a given model response to include expressions of near-identical thoughts. Conversely,... See more
Memorization vs learning concepts and forming models of the world.
The web is no longer primarily human-generated text created for human readers; it is increasingly AI-generated text created for algorithmic amplification, mixed with human-generated text optimized for the same algorithmic reward functions.
As AI systems train on this degraded corpus, they learn to reproduce its characteristics—shallow reasoning,... See more