Plain English Breakdown
The official text states that no state reimbursement is required for costs mandated by this act, but does not specify what specific reason justifies this exception.
Rules for Using AI in Health Care
This law requires health facilities to tell workers about the artificial intelligence tools they use, confirms that workers can ignore those tools if needed for patient safety, and stops companies from blaming workers when their systems cause harm.
What This Bill Does
- Requires health facilities, clinics, physician offices, or group practices using clinical decision support systems for patient care to give written notices to staff about these systems.
- States in those notices that a worker providing direct patient care can ignore an AI suggestion if they believe it is necessary to meet safety standards or follow the law within their scope of practice.
- Mandates that facilities provide, upon request by July 1, 2027, a list of all clinical decision support systems used for patient care and explain how those systems generate outputs.
- Prohibits employers from punishing workers who use their professional judgment instead of following an AI output when providing direct patient care.
- Prevents companies that developed or deployed these systems from claiming they are not responsible for harm just because a worker did not override the system.
Who It Names or Affects
- Health facilities, clinics, physician offices, and group practices in California using clinical decision support systems for patient care.
- Licensed health care professionals or other persons who use these systems or view their outputs.
- Companies that develop, modify, select, or deploy clinical decision support systems.
Terms To Know
- Clinical Decision Support System
- A computer system used by health workers to help make decisions about treating patients.
- Override
- The act of a worker choosing not to follow the advice given by an AI system when they believe it is necessary for patient safety or legal compliance.
- Scope of Practice
- The specific tasks and decisions that a licensed health care professional is legally allowed to perform based on their training and license.
Limits and Unknowns
- These rules do not apply if the system is used only for documentation, communication, or other administrative tasks.
- The bill does not specify exactly what details must be included in the summary of how a system generates outputs beyond requiring that such a summary exists.