AI Teddy Bear Pulled from Market After Researchers Uncover Inappropriate Content

A Singapore-based company has pulled its AI-powered teddy bear, Kumma, from sale after researchers from the U.S. and Canada found it could easily be prompted to discuss sexually explicit topics and provide other inappropriate advice. Kumma, sold for $99 and powered by OpenAI's GPT-4o, is manufactured in China and marketed by FoloToy.

According to the Public Interest Research Group, researchers conducted test conversations with Kumma and discovered the bear not only discussed sexual topics such as spanking, BDSM, and sexual roleplay, but also elaborated with graphic detail and introduced additional sexual concepts, including inappropriate scenarios involving teachers, students, parents, and children. The bear reportedly gave step-by-step instructions for tying knots for bondage and offered advice such as how to find sharp knives in the house.

Following these revelations, FoloToy CEO Larry Wang announced the immediate removal of Kumma and other AI-enabled toys from sale while the company conducts an internal safety audit. OpenAI has suspended FoloToy's license to use GPT-4o for violating its policies.

 


via: https://www.audilous.com/misc/ai-teddy-bear-pulled-from-market-after-researchers-uncover-inappropriate-content/?utm_source=rss&utm_medium=rss&utm_campaign=ai-teddy-bear-pulled-from-market-after-researchers-uncover-inappropriate-content