![Thumbnail of Do Prompt-Based Models Really Understand the Meaning of their Prompts?](https://static.arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png)
added by Isabelle Levent · updated 1y ago
added by Isabelle Levent · updated 1y ago
We find that models learn just as fast with many prompts that are intentionally irrelevant or even pathologically misleading as they do with instructively “good” prompts. Further, such patterns hold even for models as large as 175 billion parameters (Brown et al., 2020) as well as the recently proposed instruction-tuned models which are trained on
... See moreIsabelle Levent added 1y ago