Tech Companies Are Seeking To Develop AI That Excels at Flattering and Manipulating Us
Ryan Whalenthedebrief.org
Tech Companies Are Seeking To Develop AI That Excels at Flattering and Manipulating Us
In order not to cause offense and alienate their customers, AI creators are making them less critical and more obsequious. Research from Google has shown that AIs get more sycophantic as they become more advanced.
Joe Smith • The Optimized Marketer: Writing with AI: Future-proof Your Talent and Position Your Business for a World Transformed by AI (The Optimized Self)
Yet, the hidden machinations behind everyone’s favorite social media and search platforms are engineered to exploit our primal instincts for validation, status, and mimetic desires (adopting or pursuing preferences and aspirations based on the influence of others rather than our intrinsic motivations), morphing into a manipulative force that feeds ... See more
André Chaperon
That is, they understand the purpose of chatbots and generative models to be the ability to force other people to see a particular version of reality. It is a tool of power that masquerades as a tool of knowledge.
Rob Horning • Practico-inertia
We’re learning to be kind to AI. AI is trained on data that’s packed full of human emotions, so we can expect better performance by treating it with a little more feeling. We’re going to say thank you, experiment with motivational phrases and praise, and test and learn our way to the incentives that get AI to perform most effectively for our work. ... See more