Social Platform Trust & Safety

First, identity authentication can ensure that everyone on the platform is a human entitled to join the platform...no bots, and maybe no commercial companies. It used to be that knowing someone’s identity was necessary to ensure that they had rights to participate. But much of the toxicity of current social media interactions is about identities as... See more

For synthetic media to reach millions of views—as the Swift images did in just hours—they need massive, aggregated networks, which allow them to identify an initial audience and then spread. As the amount of available content grows with the broader use of generative AI, social media’s role as curator will become even more important.

While prior work suggests that trolling behavior is confined to a vocal and antisocial minority, we demonstrate that ordinary people can engage in such behavior as well. We propose two primary trigger mechanisms: the individual's mood, and the surrounding context of a discussion (e.g., exposure to prior trolling behavior). Through an experiment... See more

Open signups are a business decision. There are many ways that a platform could make it harder to get an account. Lots of real-world privileges have more steps – government IDs like passports or drivers licenses, obviously, but also financial transactions like bank accounts, car loans, or mortgages; or joining high-status organizations like social... See more