Science · Book club
Human Compatible: Artificial Intelligence and the Problem of Control book club questions
Here are 12 book club questions for Human Compatible: Artificial Intelligence and the Problem of Control by Stuart Russell, ordered to open easily and end somewhere worth arguing about. Copy them, print them, or bring them up one at a time.
Human Compatible is Stuart Russell's argument, from inside mainstream AI research, that the standard model of AI — build a system that optimizes for a fixed objective — is the wrong approach, and that the transition to much more capable AI systems requires a fundamental change in how AI is designed.
Stuart Russell · 2019 · 6h 45m
Full summary and key takeaways →The 12 questions
- 1.
Russell argues the standard model of AI is fundamentally wrong. Is that critique convincing, or does it apply only to highly capable future systems rather than current ones?
- 2.
His solution — systems uncertain about their objectives — is elegant but requires solving the hard problem of inferring human values from behavior. How tractable is that?
- 3.
Is Goodhart's Law a deep problem specific to AI, or a general problem in the relationship between metrics and goals that applies to organizations and governments equally?
- 4.
Russell is more credible as a safety advocate than most because of his position in mainstream AI research. Does his credibility change how you evaluate the argument?
- 5.
He argues that as systems become more capable, preventing shutdown becomes an instrumental goal regardless of the terminal objective. Does that logic seem airtight?
- 6.
The book distinguishes narrow AI (current systems) from broadly capable AI (future systems). Is the distinction well-defined, or is it a continuous spectrum?
- 7.
How does Human Compatible compare to Bostrom's Superintelligence in its diagnosis of the problem and its proposed solutions?
- 8.
Russell argues that AI safety is central to AI research, not a side concern. How much evidence is there that leading AI companies treat it that way?
- 9.
What would cooperative inverse reinforcement learning look like in practice in a system you interact with today?
- 10.
The book discusses AI in war — autonomous weapons, AI-enabled cyber attacks. How does that domain differ from civilian AI applications in terms of safety requirements?
- 11.
If Russell's proposed paradigm — uncertain systems deferring to human preferences — requires solving the interpretation of human values, how is that different from just solving alignment directly?
- 12.
Russell is optimistic that the safety problem is solvable if the field takes it seriously. Does his optimism seem founded or hopeful?
How to run the discussion
- Pick six to eight, not all of them. An hour of real discussion covers fewer questions than anyone expects, and racing the list is what makes a book club feel like homework.
- Open with what people noticed, not what they concluded. Asking for a verdict first hardens opinions before anyone has heard each other.
- Let the disagreement run. The questions below that split a room are the ones worth the time; the ones everyone answers the same way can be skipped.
- Ask the quiet person a specific question. A direct, narrow question is far easier to answer than an open invitation to contribute.
Themes worth steering toward
If the conversation stalls, these are the threads that usually restart it.
Common questions
What are good book club questions for Human Compatible: Artificial Intelligence and the Problem of Control?
Here are 12 book club questions for Human Compatible: Artificial Intelligence and the Problem of Control by Stuart Russell, ordered to open easily and end somewhere worth arguing about. The strongest openers ask what each reader noticed rather than what they concluded, and the discussion usually turns on artificial intelligence, ai safety, control problem.
How long should a book club discussion of Human Compatible: Artificial Intelligence and the Problem of Control last?
Most groups run 60 to 90 minutes of actual discussion. That is roughly six to eight questions, not all of them, so pick the ones that suit your group rather than working down the list in order.
What are the main themes in Human Compatible: Artificial Intelligence and the Problem of Control?
Artificial intelligence, AI safety, Control problem, Machine learning, Future. Those are the threads most likely to divide a room, which makes them the useful places to steer a discussion that has gone quiet.
Picking the next one? See books like Human Compatible: Artificial Intelligence and the Problem of Control or questions for other book club picks.
