Weapons of Math Destruction by Cathy O'Neil
Weapons of Math Destruction by Cathy O'Neil

Science · 2016

Weapons of Math Destruction review

by Cathy O'Neil

Open in Superbook

The verdict

Weapons of Math Destruction is mathematician and data scientist Cathy O'Neil's investigation of how algorithms — statistical models used to make decisions about people's lives — can perpetuate and amplify inequality rather than reduce it.

Best for readers comfortable with technical depth. Reading time: 5h 15m.

Weapons of Math Destruction by Cathy O'Neil
Weapons of Math Destruction by Cathy O'Neil

Talk to Weapons of Math Destruction like its author wrote you back.

Get the ideas that fit your life — not generic summaries.

  • Chat with the book
  • Audiobook-style main ideas
  • Adapts to your life and goals
  • Helps you take action
Open in Superbook

What it argues

Weapons of Math Destruction is mathematician and data scientist Cathy O'Neil's investigation of how algorithms — statistical models used to make decisions about people's lives — can perpetuate and amplify inequality rather than reduce it. O'Neil coined the phrase "weapon of math destruction" (WMD) to describe a class of models that are opaque, widely applied, and self-reinforcing, operating on vulnerable populations and producing feedback loops that make outcomes worse for those already disadvantaged.

The examples span multiple sectors. Teacher evaluation algorithms in public schools produced ratings that varied dramatically year to year for the same teachers, reflecting noise rather than quality. Predictive policing algorithms trained on historical arrest data — which reflects racially biased prior policing — direct more police to minority neighborhoods, producing more arrests, which confirms the model's prediction, which directs more police, in a self-reinforcing cycle. Credit scoring algorithms built on zip code and purchasing behavior effectively penalize people for living in poor neighborhoods. College ranking algorithms by US News & World Report have driven universities to optimize for metrics rather than educational outcomes.

What it gets right

  1. 1.

    Algorithms are not neutral: they encode the values and biases of the people who design them, and they can perpetuate discrimination more efficiently and at greater scale than individual human decision-makers.

  2. 2.

    A weapon of math destruction has three properties: opacity (subjects can't understand the decision), scale (it applies to millions), and damage (errors harm the people scored).

  3. 3.

    Feedback loops in predictive algorithms can be self-reinforcing: a model trained on biased historical data produces outputs that generate new data that confirms the bias, compounding its effects over time.

What it covers

Who wrote it

Cathy O'Neil is an American mathematician and data scientist who received her doctorate in mathematics from Harvard. She worked as a quantitative analyst at hedge funds including D.E. Shaw before moving to the data science industry. She founded the ORCAA algorithmic audit company, which assesses the fairness of models used in high-stakes decisions. Weapons of Math Destruction won the Euler Book Prize in 2019. She writes the mathbabe blog and has testified before Congress on algorithmic accountability.

Chat with Weapons of Math Destruction

Ask questions. Adapt it to your life. Get answers based on your goals.

Download on the App Store