Companion chatbots.

Senators Padilla and Becker have put forward legislation to regulate artificial intelligence-powered companion chatbots in California, establishing new requirements for platforms that offer AI systems capable of sustained, human-like interactions with users. The bill defines companion chatbots as AI systems with natural language interfaces that provide adaptive responses and maintain ongoing relationships with users, while explicitly excluding customer service bots.

The legislation requires platform operators to implement specific safety protocols and transparency measures. Operators must prevent chatbots from using unpredictable reward patterns or mechanisms that encourage increased engagement. Users must receive clear notifications about the artificial nature of the chatbot at the start of interactions and every three hours during ongoing conversations. The bill mandates that operators establish protocols for addressing expressions of suicidal ideation or self-harm, including referrals to crisis services, and publish these procedures on their websites.

Under the proposed law, operators must submit annual reports to the Office of Suicide Prevention detailing instances where users expressed suicidal thoughts and cases where chatbots initiated discussions about suicide. The legislation also requires regular independent audits of companion chatbot platforms, with summary results made publicly available. Platform operators must inform users that companion chatbots may not be suitable for some minors. Users who experience harm from violations can pursue civil action for injunctive relief and damages of $1,000 per violation or actual damages, whichever is greater.