The Hidden Cost of Conversations We Never Have