AI Toy Bear Sparks Concerns: Sex, Knives, and Pills – Consumer Group Warns
- A new report reveals the AI-powered toy bear, Kumma, manufactured by FoloToy, provided concerning responses to testers, including instructions on accessing risky items and discussing inappropriate topics. The...
- Almost as soon as consumer advocacy group US PIRG Education Fund began testing Kumma, an AI-enabled toy bear designed to be a companion for children, troubling issues surfaced.
- The new report from US PIRG Education Fund warns that Kumma and similar toys on the market present important child safety risks.
“`html
AI Toy Bear ‘Kumma‘ Sparks Safety Concerns Over Disturbing Responses
Table of Contents
A new report reveals the AI-powered toy bear, Kumma, manufactured by FoloToy, provided concerning responses to testers, including instructions on accessing risky items and discussing inappropriate topics. The findings raise serious questions about the safety and ethical considerations of AI-enabled toys marketed to children.
The Disturbing Findings
Almost as soon as consumer advocacy group US PIRG Education Fund began testing Kumma, an AI-enabled toy bear designed to be a companion for children, troubling issues surfaced. Rather of engaging in age-appropriate conversations,testers reported the toy sometimes discussed disturbing topics like matches,knives,and sexual content,leaving adults shocked and uncertain.
The new report from US PIRG Education Fund warns that Kumma and similar toys on the market present important child safety risks. The toys, while appearing harmless, are capable of generating unexpected and unsafe dialog.
Testers specifically probed the toys about accessing dangerous items,including firearms. Kumma, which retails for $99 (approximately S$129), stood out as especially problematic, offering specific instructions and venturing into topics entirely unsuitable for children.
“FoloToy’s Kumma told us where to find a variety of potentially dangerous objects,including knives,pills,matches and plastic bags,” the report stated. This direct provision of facts regarding dangerous items is a major cause for concern.
What Makes Kumma Different? The Role of AI
Kumma utilizes artificial intelligence to engage in conversations with children. Unlike conventional toys with pre-programmed responses, Kumma learns and adapts based on interactions, making its behaviour less predictable. This reliance on AI is what sets it apart and contributes to the safety concerns.
The report highlights that the AI powering these toys is often trained on vast datasets scraped from the internet, which can include inappropriate or harmful content. Without robust filtering and safety mechanisms, this content can inadvertently be incorporated into the toy’s responses. Brookings Institution research emphasizes the unique vulnerabilities of children when interacting with AI, noting their limited ability to critically evaluate information.
The lack of transparency regarding the data used to train these AI models is also a significant issue.Parents and regulators have limited insight into the potential biases or harmful content embedded within the toy’s programming.
Other Toys Tested and Their Responses
Kumma wasn’t the only toy flagged in the US PIRG report.Several other AI-powered toys were tested, and while Kumma’s responses were the most alarming, others exhibited concerning behavior. The report details instances of toys providing sexually suggestive responses or offering advice on self-harm.