"Violation of Expectation via Metacognitive Prompting Reduces Theory of Mind Prediction Error in Large Language Models"
This paper investigates how Violation of Expectation (VoE) and metacognitive prompting can be used to reduce Theory of Mind prediction errors in Large Language Models (LLMs) in the context of human-AI interaction.
Metacognitive Prompting
The overall goal is to create AI systems that can deeply understand and align with individual human users. To achieve this, the researchers propose using a learning technique inspired by cognitive science theories about how human brains work.… Show more
Participants in three experiments wrote gratitude letters and then predicted how surprised, happy, and awkward recipients would feel. Recipients then reported how receiving an expression of gratitude actually made them feel. Expressers significantly underestimated how surprised recipients would be about why expressers were grateful, overestimated... See more
IFS is grounded in the observation that the mind is naturally multiple, housing a variety of subpersonalities, or parts . We experience this multiplicity when we feel torn between conflicting desires; maybe part of us wants to pursue a challenging opportunity, but another part fears the risk, while a third part feels exhausted by the inner debate.