The Invisible Labor of Content Moderation

The essential truth of every social network is that the product is content moderation, and everyone hates the people who decide how content moderation works. Content moderation is what Twitter makes — it is the thing that defines the user experience. It’s what YouTube makes, it’s what Instagram makes, it’s what TikTok makes. They all try to incenti... See more

With a few exceptions, by far the most important component of successful speech communities is that its moderators have faces . A core feature of bulletin boards, comment threads on blogs, and publications is that the boundaries of acceptable speech are enforced not by tech executives, the farcical Facebook Supreme Court,[xii] or distant buildings ... See more

As communities grow, so too does their need for moderation to ensure that content does not become toxic. In communities where moderation is vital, like group therapy, these solutions can augment human moderators and allow services and platforms to scale. AI-based moderation is rarely cost-effective for a platform to build in-house.

Community moderation works . This was the overwhelming lesson of the early internet. It works because it mirrors the social interaction of real life, where social groups exclude people who don’t fit in. And it works because it distributes the task of policing the internet to a vast number of volunteers, who provide the free labor of keeping forums

... See more

Even if content moderation were implemented perfectly, it would still miss a whole host of issues that are often portrayed as moderation problems but really are not. To address those non-speech issues, we need a new strategy: treat social media companies as potential polluters of the social fabric, and directly measure and mitigate the effects thei... See more

Here, design, development, and content creation are no longer merely tools for generating revenue; they are also tools of community organizing. Here, design and engineering take on the valence of care, and the emotional involvement of being a contributor, moderator, and member. Where does “design” end and “moderation” begin? Because the mainstream ... See more