Technology and digital policy

A hiring algorithm screens 10,000 applicants and forwards 200 to human reviewers. The 9,800 rejected candidates never know what criteria eliminated them, whether those criteria were relevant to job performance, or whether they would have been rejected by human screeners. A lending algorithm approves one applicant and denies another with similar financial profiles, the difference traceable to zip codes that correlate with race through historical segregation patterns.

A person is denied a loan and asks why. The bank's representative explains that the decision was made by an algorithm but cannot say what factors drove the denial or how the applicant might improve their chances. A defendant receives a longer sentence based partly on a risk assessment tool that assigns them high likelihood of reoffending, but neither defendant nor judge can examine what variables produced that score.

A landmark study reveals that facial recognition systems from major technology companies achieve near-perfect accuracy on light-skinned male faces while error rates for dark-skinned women reach 35 percent. A Black man in Detroit spends 30 hours in jail after facial recognition software misidentifies him as a shoplifting suspect, his face apparently interchangeable with another Black man's in the eyes of the algorithm.

A Black man in Detroit is wrongfully arrested after facial recognition software misidentifies him, spending 30 hours in jail for a crime he did not commit while his family wonders where he has gone. A woman in Austria receives a lower employability score from a government algorithm because she is female and over 30, reducing her access to job training programs. Thousands of Dutch families are falsely accused of childcare benefit fraud by an algorithmic system that disproportionately targeted immigrants and dual nationals, leading to financial ruin, family separations, and suicides.

The European Union adopts the AI Act establishing risk-based regulation with conformity assessments, prohibited practices, and penalties reaching tens of millions of euros. A technology company publishes AI ethics principles committing to fairness, transparency, and human oversight while deploying systems that produce documented discriminatory outcomes. A professional organization releases guidelines for responsible AI that members may adopt voluntarily or ignore without consequence.

A healthcare algorithm is developed by engineers and data scientists in a technology company, tested by clinicians at academic medical centers, and deployed across hospitals serving diverse populations whose health patterns, care-seeking behaviors, and life circumstances differ dramatically from those who designed and validated the system. A predictive policing tool is purchased by a city government without consulting the neighborhoods where it will direct police attention, communities with long histories of over-policing who could have predicted the harms that later materialized.

A healthcare algorithm trained on data from academic medical centers performs poorly for rural populations whose health patterns differ from urban teaching hospital patients. A facial recognition system achieves 99% accuracy on light-skinned faces but fails on darker-skinned faces because training data dramatically underrepresented people of color. A hiring algorithm learns that successful employees were predominantly male because historical data reflects decades of discriminatory hiring, not because men are actually better candidates.

A thirteen-year-old creates a social media account, agreeing to terms of service she does not read and could not understand if she did, granting the platform permission to collect her location, her contacts, her browsing habits, her messages, and her behavioral patterns, building a profile that will follow her into adulthood and be sold to advertisers, data brokers, and unknown third parties for purposes no one explains.

Consider the experience of Elena, a twelve-year-old student in suburban Ottawa. Her afternoon routine involves completing homework on a tablet and chatting with classmates on a popular social media platform. Recently, however, she has begun to feel a distinct anxiety when her device notifies her of a new message. A rumor, false and damaging, has spread through a group chat, accompanied by edited images that mock her appearance.

Consider the quiet frustration of Arthur, a 72-year-old retired teacher living in a small town in Saskatchewan. He has spent the last three weeks trying to schedule a routine appointment with his family physician through the provincial health portal. The interface requires a two-factor authentication code sent to his smartphone—a device he owns but rarely uses for anything other than voice calls. The screen prompts him to "verify identity," but Arthur is unsure if he is looking at a legitimate government site or a sophisticated phishing attempt.