What it argues
Weapons of Math Destruction is mathematician and data scientist Cathy O'Neil's investigation of how algorithms — statistical models used to make decisions about people's lives — can perpetuate and amplify inequality rather than reduce it. O'Neil coined the phrase "weapon of math destruction" (WMD) to describe a class of models that are opaque, widely applied, and self-reinforcing, operating on vulnerable populations and producing feedback loops that make outcomes worse for those already disadvantaged.
The examples span multiple sectors. Teacher evaluation algorithms in public schools produced ratings that varied dramatically year to year for the same teachers, reflecting noise rather than quality. Predictive policing algorithms trained on historical arrest data — which reflects racially biased prior policing — direct more police to minority neighborhoods, producing more arrests, which confirms the model's prediction, which directs more police, in a self-reinforcing cycle. Credit scoring algorithms built on zip code and purchasing behavior effectively penalize people for living in poor neighborhoods. College ranking algorithms by US News & World Report have driven universities to optimize for metrics rather than educational outcomes.
What it gets right
- 1.
Algorithms are not neutral: they encode the values and biases of the people who design them, and they can perpetuate discrimination more efficiently and at greater scale than individual human decision-makers.
- 2.
A weapon of math destruction has three properties: opacity (subjects can't understand the decision), scale (it applies to millions), and damage (errors harm the people scored).
- 3.
Feedback loops in predictive algorithms can be self-reinforcing: a model trained on biased historical data produces outputs that generate new data that confirms the bias, compounding its effects over time.
What it covers
Who wrote it
Cathy O'Neil is an American mathematician and data scientist who received her doctorate in mathematics from Harvard. She worked as a quantitative analyst at hedge funds including D.E. Shaw before moving to the data science industry. She founded the ORCAA algorithmic audit company, which assesses the fairness of models used in high-stakes decisions. Weapons of Math Destruction won the Euler Book Prize in 2019. She writes the mathbabe blog and has testified before Congress on algorithmic accountability.