AI Toys Exposed 50,000 Children's Conversations. They're Still Being Sold

The video exposes how AI-powered toys like Curio, Bondu, and Mo are collecting and storing sensitive children’s data—including conversations and facial information—while companies fail to implement basic security measures, leading to massive privacy breaches. Despite these risks and the dual-use nature of the AI technology, there is little public concern or effective regulation, leaving children’s privacy and safety vulnerable.

The video investigates the growing market of AI-powered toys designed for children, highlighting serious privacy and security concerns. These toys, such as Curio, Bondu, and Mo, are marketed as interactive companions that can help children with emotional regulation, learning, and play, often as an alternative to excessive screen time. They use advanced AI models like OpenAI’s ChatGPT and Google’s Gemini, and are equipped with microphones, cameras, and internet connectivity, allowing them to record and store conversations and even recognize faces. Parents are drawn to these toys for their educational and companionship value, especially when traditional therapy or social interaction is limited.

Despite claims of safety and secure data handling, the video exposes multiple instances where these companies failed to protect children’s privacy. Researchers were able to access over 50,000 private conversations between children and their Bondu plushies simply by logging into a web portal with a Google email. Similarly, the Mo robot’s database was left unprotected, allowing anyone to download thousands of audio files containing children’s interactions. These breaches reveal that companies are not following basic security protocols, putting sensitive information—including names, birthdates, and even facial data—at risk.

The video draws a stark comparison between today’s acceptance of AI toys and past public reactions to less sophisticated toys. In the 1990s, the Furby was banned by the Pentagon over unfounded fears of eavesdropping, despite lacking recording capabilities. In 2017, Cloud Pets, another internet-connected toy, suffered a massive data breach, leading to public outrage and removal from major retailers. However, today’s far more invasive AI toys have not sparked similar concern, even as they collect and store much more sensitive data.

A particularly troubling aspect is the overlap between the AI technology used in children’s toys and that deployed in military and surveillance operations. The same AI models powering these toys are being used by the US military for intelligence and battlefield operations. The video notes that only one company, Anthropic, has resisted military use of its AI, facing government pressure as a result. This raises ethical questions about the dual-use nature of AI and the lack of transparency regarding how children’s data might be used to train these powerful models.

Finally, the video criticizes the lack of effective regulation and enforcement. While the FTC has rules under the Children’s Online Privacy Protection Act (COPPA), enforcement is reactive rather than preventive, allowing companies to sell privacy-violating toys until they are caught. The video warns that internet-connected devices, especially those with cameras and microphones, are vulnerable to hacking and misuse. It concludes by lamenting society’s complacency, as parents now willingly bring sophisticated surveillance devices into their homes, risking children’s privacy and emotional well-being for the promise of companionship and convenience.