It means that if you yearn to be free of a particular relationship and you feel that yearning lodged within you more firmly than any of the other competing and contrary yearnings are lodged, your desire to leave is not only valid, but probably the right thing to do. Even if someone you love is hurt by that.