Meta CTO thinks bad metaverse moderation could pose an ‘existential threat’

As communities grow, so too does their need for moderation to ensure that content does not become toxic. In communities where moderation is vital, like group therapy, these solutions can augment human moderators and allow services and platforms to scale. AI-based moderation is rarely cost-effective for a platform to build in-house.

Warzel: Something I’ve found kind of crushing is the lack of imagination from companies and actors in this space. You can literally build any possible vision of the future you want, detached from the laws of physics and reality, and you have Meta and others saying, Let’s do virtual meetings! You have people focused on trying to parcel up metav... See more

People talk a lot about how these worlds allow you to be freer than in the physical world but there’s a flipside where people can sometimes be worse in these spaces because people feel freer to be assholes. It’s not a good thing or a bad thing necessarily—these are simply just challenges that exist in these virtual worlds.