Because the independent-minded find it uncomfortable to be surrounded by conventional-minded people, they tend to self-segregate once they have a chance to.
It is a strange thing: we acknowledge the generally social nature of our species, but resist acknowledging the specifically social nature of our intelligence.