SUMMARY - Algorithmic Explainability
A loan application is denied by an automated system. The applicant receives an explanation: "insufficient credit history and high debt-to-income ratio." They understand the stated reasons but have no visibility into how the algorithm weighted these factors, what thresholds determined the decision, or whether the model considered proxy variables that effectively discriminated based on protected characteristics. Another person is rejected for a job by AI screening software.