Exercises: Decomposing Tasks for Better Supervision

Resources: Decomposing Tasks for Better Supervision

Exercises: Interpretability 9

Resources: Interpretability 9

Exercises: Track 1: Eliciting Latent Knowledge

Resources: Track 1: Eliciting Latent Knowledge

Exercises: Literature Review or Project Proposal

Resources: Literature Review or Project Proposal

Next steps: Programs

Exercises: Track 3: Science and Deep Learning

Resources: Track 3: Science and Deep Learning

Exercises: Reasoning about Reasoning

Resources: Reasoning about Reasoning

Exercises: Further Understanding the Alignment Problem

Resources: Further Understanding the Alignment Problem

Exercises: Preventing Misgeneralization

Resources: Preventing Misgeneralization

Exercises: Track 2: Agent Foundations

Resources: Track 2: Agent Foundations

Compare the definition of power given by [Turner et al.](https://arxiv.org/pdf/1912.01683.pdf) with the definition of empowerment from [Klyubin et al.](https://ieeexplore.ieee.org/document/1554676) Which is more relevant to the goals that real-world policies might learn, and why? (For one answer, see Turner et al.’s appendix.)



Power and empowerment

This session dives deeper into non-obvious aspects of the alignment problem. It sets out the problems that many of the further sessions in this course will try to address.


Alignment 201

Further Understanding the Alignment Problem

Decomposing Tasks for Better Supervision

Preventing Misgeneralization

Interpretability (201)

Reasoning about Reasoning

Track 1: Eliciting Latent Knowledge

Track 2: Agent Foundations

Track 3: Science and Deep Learning

Literature Review or Project Proposal