Isabelle Levent

There are a couple reasons why Wordcraft may have struggled with style and voice... Another reason could have been limitations of the underlying model. LaMDA and other similar language models are trained to be most confident on the kind of text they see most often–typically internet data. However, professional creative writers are usually writing

In the course of a year, the tech industry’s dreary post-social, post-crypto interregnum was rapidly supplanted — largely as the result of public-facing efforts by OpenAI, which is reportedly in talks with Microsoft about a potential $10 billion investment — by a story about inevitable technologies that are  so  transformative,  so  incomprehensibl

The “story seeds” control allowed writers to experiment with using Wordcraft to generate ideas at the very beginning of the writing process. MT described the “story seeds” control as giving her “a place on my computer to go that looked like a blank page but did not behave as such.” E

Strict synonymy, or even a drop-in replacement word, is not essential for most writers, who instead may use a thesaurus to expand an idea or discover a new one. 

We find that models learn just as fast with many prompts that are intentionally irrelevant or even pathologically misleading as they do with instructively “good” prompts. Further, such patterns hold even for models as large as 175 billion parameters (Brown et al., 2020) as well as the recently proposed instruction-tuned models which are trained on

The Lab’s primary focus is on the ways in which artists and designers are adopting, adapting and remaking AI processes, building their own datasets and reaching into the ‘grey box’ of AI technologies.