Nurses push for AI limits in California healthcare

Nurses in California are urging Governor Gavin Newsom to sign two new laws that would place strict limits on the use of artificial intelligence in healthcare settings. The legislation, which passed both houses of the state legislature despite opposition from hospital corporations and tech industry groups, aims to protect patient safety and preserve the professional judgment of licensed medical staff. It represents a significant shift in how the state handles the rapid integration of AI tools into clinical environments.

The core concern driving these bills is the fear that automated systems could override human decision-making in critical moments. Union representatives argue that nurses currently serve as the final check against errors, and that allowing untested AI to dictate care without clear accountability mechanisms poses a risk to patients. The measures are designed to ensure that technology remains a tool under human control, rather than an autonomous agent with the power to override medical professionals.

Protecting clinical judgment from automation

One of the bills, AB 1979, explicitly prevents healthcare entities from using AI to replace the clinical judgment of licensed professionals. It also mandates that companies offering AI health applications that access medical records must comply with California’s existing medical confidentiality laws. This addresses a growing gap where direct-to-consumer health chatbots might access sensitive data without adhering to the same privacy standards as traditional medical providers.

The second bill, AB 2575, focuses on the rights of healthcare workers. It affirms their right to override unsafe or inappropriate AI outputs without fear of retaliation from employers. Furthermore, it limits the ability of AI developers and deployers to evade liability for harm caused by their systems. This includes preventing companies from blaming a human worker who interacted with the tool as a defense against legal responsibility.

Corporate opposition and regulatory stakes

The passage of these bills was not uncontested. A coalition of hospital corporations, health plans, and technology industry groups spent months lobbying to weaken or kill the legislation. Their opposition highlights the tension between corporate interests in deploying AI for efficiency and cost reduction, and the professional and public interest in maintaining human oversight and safety. The outcome in California is expected to set a precedent for other states and industries.

Deadline for executive action

The legislation is now awaiting a signature from Governor Newsom, who has until September 30, 2026, to sign or veto the bills. If signed, the laws will establish some of the strongest protections for patients and healthcare workers against untested AI in the nation. If vetoed, the status quo remains, leaving the integration of AI in healthcare largely unregulated by state law regarding professional judgment and liability.