Matt M

This is not a problem that is limited to Facebook or even social media, as figuring out how to make automated systems responsive to our values, rather than blindly following a reasonable objective function, is a pervasive question, often referred to as value alignment.  It underlies questions about whether optimizing for GDP and stock price is actually good for society and has become even more critical as AI-driven systems create myriad optimization opportunities that all have the potential to go wrong (e.g. balancing safety vs. efficiency of self-driving cars, cost vs. health benefit for managing health resources, worker productivity vs. well-being for the gig economy).