Loading...
Loading...
A failure mode where the cognitive tendency to over-trust machine outputs becomes institutional rather than personal. Outputs become defaults; deviation requires justification while conformity does not. Human judgment is exercised relative to the model, not independently. Oversight persists in form but not in substance.
Individually, loan officers might question model recommendations. Institutionally, their performance metrics reward throughput, their managers ask about overrides, and their peers all follow the model. Automation bias is no longer individual psychology—it's organisational structure.
Section 6.1: Institutionalised Automation Bias