Noise: A Flaw in Human Judgment book club questions

1. 1.

   The book's central claim is that noise is as damaging as bias but gets far less attention. Why do you think bias has dominated the conversation?

2. 2.

   Occasion noise means your judgments vary based on what you ate for lunch, the weather, and other irrelevant factors. How do you feel about this finding? Does it change how you think about your own professional judgments?

3. 3.

   The three authors argue that algorithms, even imperfect ones, typically outperform human judges in predictive tasks. Where do you most want humans to maintain judgment authority, and why?

4. 4.

   The book recommends averaging multiple independent judgments as a noise-reduction strategy. What would this look like in your workplace for high-stakes decisions?

5. 5.

   They distinguish between objective noise (variability in judgments relative to ground truth) and error noise (variability relative to each other). What domains in your life have measurable ground truth that you are not measuring?

6. 6.

   Decision hygiene means building processes that reduce noise before measuring whether noise is actually reduced. What hygiene practices do you currently use in your most important decision contexts?

7. 7.

   The book argues that most professional training focuses on reducing bias but ignores noise. What would noise-reducing training look like?

8. 8.

   Kahneman wrote Thinking, Fast and Slow with a focus on cognitive biases. Does Noise feel like a revision of that framework or an extension of it?

9. 9.

   They discuss legal sentencing as a domain with enormous noise. What is your reaction to the prescription that sentencing guidelines and structured algorithms should replace or constrain judicial discretion?

10. 10.

    Where in your professional domain have you noticed noise that no one is measuring or addressing?

11. 11.

    The authors recommend postponing deliberation and collecting independent initial judgments before discussion. Have you seen this practice attempted? What happened?

How to run the discussion

• Pick six to eight, not all of them. An hour of real discussion covers fewer questions than anyone expects, and racing the list is what makes a book club feel like homework.
• Open with what people noticed, not what they concluded. Asking for a verdict first hardens opinions before anyone has heard each other.
• Let the disagreement run. The questions below that split a room are the ones worth the time; the ones everyone answers the same way can be skipped.
• Ask the quiet person a specific question. A direct, narrow question is far easier to answer than an open invitation to contribute.