Social Platform Trust & Safety

If we want to protect the rights of real people, it should be much harder to take away someone’s account and online property. But that only works if we have a way to know which accounts belong to a real and specific human with an authentic connection to the community. That implies more stringent validation requirements to get and keep an account.

it's a mistake to think there's some perfect institutional design out there that's going to create the just world that we want. Whatever institutional design you have, humans are humans, and humans are going to strategically manipulate those institutions to try to achieve their ends. And there are going to be inequalities, power disparities, and... See more

Barriers to entry : One way to avoid creating a platform crushed by questions about how to deal with bad actors is to raise the cost of entry. Barriers to entry may take the form of geographic localization, interest segmentation, high cost of discovery, or strong gatekeeping.

We tend to think of the problem of social media as a problem of disinformation - that is, of people receiving erroneous information and being convinced that false things are in fact true. Hence, we can try to make social media better through factchecking, through educating people to see falsehoods and similar. This is, indeed, a problem, but it is... See more

Some users may not want to see any potentially abusive content at all, while others may, for example, need to sift through banal personal attacks in order to track credible death threats. The point, however, is that users themselves should be able to exercise significantly more agency over their own social media experience.

But if this ideal of freedom may be absolute within its domain, this is possible only because the domain is narrow, tightly limited by rigorous conditions for entering it.