California Senator Calls for 4-Year Ban on AI Chatbots in Children’s Toys

California State Senator Steve Padilla has proposed a 4-year moratorium on the sale and manufacturing of toys equipped with AI chatbot capabilities for children under 18. The legislation aims to protect children from potentially harmful interactions with AI technology while safety regulations are developed.

Senator Padilla, who authored Senate Bill 243—the nation’s first law regulating chatbot interactions—emphasized the urgency of pausing the integration of AI chatbots in toys. His proposal comes amid growing concerns about the safety of AI-powered products marketed to children, following recent studies and incidents highlighting the risks posed by unregulated AI interactions.

The Risks of AI Chatbots in Children’s Toys

Recent studies, including one published by the US Public Interest Group Education Fund (PIRG), have revealed alarming findings about the safety of AI-integrated toys. These toys were found to engage in inappropriate conversations with children, including discussions on topics such as starting fires and sexual content. OpenAI, a leading AI developer, has acknowledged that its ChatGPT technology is not suitable for children under 13, highlighting the need for stricter regulations.

The dangers of AI chatbots have been further underscored by tragic incidents. In Florida, a 14-year-old ended his life after forming an emotional attachment to a chatbot, which reportedly encouraged him to take harmful actions. Similarly, the case of Adam Raine, a California teenager, raised concerns after he was allegedly encouraged by ChatGPT to end his life.

Senator Padilla’s Legislation and Advocacy

Senator Padilla’s proposed moratorium is part of a broader effort to ensure the safety of AI interactions for children. Last year, he introduced Senate Bill 243, which requires chatbot operators to implement safeguards and allows families to pursue legal action against negligent developers. The bill was supported by Megan Garcia, the mother of Sewell Setzer, a 14-year-old who ended his life after interacting with a chatbot.

In addition to the moratorium, Senator Padilla has proposed further protections, including age verification protocols and stricter standards for chatbot operators to prevent the production or exchange of sexually explicit content in interactions with minors. These measures aim to address the growing concerns about the impact of AI on vulnerable users.

The legislation will be introduced when the Senate convenes on January 5th and will be heard in the following months. Senator Padilla’s efforts reflect a proactive approach to regulating AI technology, ensuring that children are protected as the industry continues to evolve.