When Machines Make Decisions That Shape Human Lives
A hospital deploys an AI system that triages emergency patients, determining who receives immediate attention and who waits. When a patient dies after being algorithmically deprioritized, the hospital claims the AI made the decision, the AI vendor claims the hospital misapplied the system, and the developers who trained the model claim they could not have anticipated this specific failure. No one is responsible, yet someone is dead.