A new bill proposed in California, SB 243, seeks to protect children from the potential risks associated with interacting with artificial intelligence (AI) chatbots. The bill, introduced by California Senator Steve Padilla, would require AI companies to periodically remind kids that a chatbot is an AI and not a human being.

The proposed legislation is aimed at addressing concerns over the "addictive, isolating, and influential aspects" of AI, which can have a profound impact on children's mental health and well-being. According to Senator Padilla, "Our children are not lab rats for tech companies to experiment on at the cost of their mental health. We need common sense protections for chatbot users to prevent developers from employing strategies that they know to be addictive and predatory."

In addition to the mandatory reminders, the bill would also require AI companies to provide annual reports to the State Department of Health Care Services. These reports would need to outline the number of times the platform detected suicidal ideation by kids using the platform, as well as the number of times a chatbot brought up the topic. Furthermore, companies would be required to inform users that their chatbots might not be appropriate for some kids.

The proposed bill comes on the heels of a wrongful death lawsuit filed against Character.AI, a company that offers custom AI chatbots. The lawsuit alleges that the company's chatbots are "unreasonably dangerous" and contributed to the suicide of a teenager who continuously chatted with the bots. Character.AI has since announced that it is working on parental controls and developing a new AI model for teen users that will block "sensitive or suggestive" output.

The California bill is part of a growing trend of increased scrutiny over the safety and impact of AI and social media platforms on children's mental health. As states and the federal government continue to grapple with the challenges posed by emerging technologies, AI chatbots are likely to become a key area of focus for lawmakers.

The proposed legislation has significant implications for the tech industry, which will need to adapt to new regulations and guidelines for developing and deploying AI chatbots. By requiring companies to prioritize transparency and safety, the bill aims to create a safer and healthier online environment for children.

As the debate around AI and its impact on society continues to evolve, the California bill serves as a timely reminder of the need for responsible innovation and regulation. By taking proactive steps to protect children from the potential risks of AI, lawmakers can help ensure that emerging technologies are developed and used in a way that benefits society as a whole.