But if this ideal of freedom may be absolute within its domain, this is possible only because the domain is narrow, tightly limited by rigorous conditions for entering it.

A crucial element to lowering the stakes of any particular moderation decision is the knowledge that the user has the genuine option to go to another community or start his own. The same applies to moderators: The ultimate check on a moderator’s power is that if most users start to believe he is using it poorly, users can either protest until a new... See more

Moreover, the metaphor breaks down entirely in a post-scarcity, algorithmically mediated world, where there is no obvious relationship between the opinions a person puts forth and where that opinion shows up, often in a mechanically distorted way. The marketplace of ideas assumes a relatively even distribution of megaphones, or a random... See more

It is because a universal public square cannot be a community that the parameters of the online speech debate are stuck. The conflict between the “marketplace of ideas” framework and the “communal norms” framework seems irresolvable because it is irresolvable.

And yet, precisely as the platforms became more universal, they became more destructive of community. Communal in clusion relies on ex clusion: some notion of who is and is not a member of the group, and some ways of enforcing that boundary.

Max Weber introduced a three-fold typology of legitimacy, the sentiments that get people to acquiesce to authority, especially regarding rules or commands they may dislike or disagree with.[viii] For most of human history, the most common kinds of authority have been traditional or charismatic. Traditional authority appeals to the “eternal... See more

The mistake of the 1.0 platforms was to optimize for engagement—likes, clicks, and shares. This was a successful short-term growth strategy, but at the long-term cost of sustainability. For engagement includes not only joy but rage, not only mirth but sadness. Incentivizing these things creates hellishness, driving people to disengage, to become... See more

But the problems of the speech platforms are not ones of bad actors at the fringes. Rather, they are baked into the incentive structures of the platforms themselves, through the kinds of speech they reward and penalize. The platforms are rotten to the core, inducing us all to become noxious versions of ourselves.

Without trust in the decision-maker, trust in the process breaks down, and the only important question becomes, “Who decides?”