Isabelle Levent

We find that models learn just as fast with many prompts that are intentionally irrelevant or even pathologically misleading as they do with instructively “good” prompts. Further, such patterns hold even for models as large as 175 billion parameters (Brown et al., 2020) as well as the recently proposed instruction-tuned models which are trained on

“There are real concerns with respect to the copyright of outputs from these models and unaddressed rights issues with respect to the imagery, the image metadata and those individuals contained within the imagery,” said Peters.

They will shade our constant submissions to the vast digital commons, intentional or consensual or mandatory, with the knowledge that every selfie or fragment of text is destined to become a piece of general-purpose training data for the attempted automation of everything. They will be used on people in extremely creative ways, with and without

Strict synonymy, or even a drop-in replacement word, is not essential for most writers, who instead may use a thesaurus to expand an idea or discover a new one. 

There are a couple reasons why Wordcraft may have struggled with style and voice... Another reason could have been limitations of the underlying model. LaMDA and other similar language models are trained to be most confident on the kind of text they see most often–typically internet data. However, professional creative writers are usually writing

What’s difficult is to state our aesthetic values clearly enough to enable the program itself to make the evaluation at each generation.