SUMMARY - Fairness in Decision-Making Systems
A hiring algorithm screens 10,000 applicants and forwards 200 to human reviewers. The 9,800 rejected candidates never know what criteria eliminated them, whether those criteria were relevant to job performance, or whether they would have been rejected by human screeners. A lending algorithm approves one applicant and denies another with similar financial profiles, the difference traceable to zip codes that correlate with race through historical segregation patterns.