Critical infrastructure: artificial intelligence systems: human oversight.

Senator McNerney's legislation mandates human oversight of artificial intelligence systems operating within California's critical infrastructure, requiring state agencies to establish monitoring protocols by July 2026. The bill defines covered AI systems as those used to operate, manage, or control access to vital sectors including energy, healthcare, transportation, and water systems.

Under the proposed requirements, designated oversight personnel must monitor AI operations in real-time and approve system-generated plans before execution, except when such review would substantially disrupt operations. The Department of Technology will develop specialized annual training in AI safety protocols and risk management techniques for these personnel. Operators must also conduct yearly assessments evaluating compliance, system performance, safety considerations, and potential vulnerabilities that could lead to significant casualties or property damage.

The legislation includes provisions protecting sensitive infrastructure information from public disclosure while establishing reporting requirements for assessment findings. These measures build upon existing cybersecurity frameworks within the California Emergency Services Act and follow the Governor's executive order establishing policies for responsible AI deployment in state government.