Resources: Adversarial techniques for scalable oversight

Exercises: Adversarial techniques for scalable oversight

Resources: Reward misspecification and instrumental convergence

Exercises: Reward misspecification and instrumental convergence

Resources: Governance (Alignment 23)

Exercises: Governance (Alignment 23)

Resources: Task decomposition for scalable oversight

Exercises: Task decomposition for scalable oversight

Resources: Careers and Projects

Exercises: Careers and Projects

Next steps: Programs

Resources: Interpretability

Exercises: Interpretability

Resources: Agent foundations

Exercises: Agent foundations

Resources: Artificial General Intelligence

Exercises: Artificial General Intelligence

Resources: Introduction to Machine Learning (23)

Exercises: Introduction to Machine Learning (23)

Resources: Goal misgeneralisation

Exercises: Goal misgeneralisation

Solving alignment technically is just part of the puzzle. Governance issues around development and deployment of AGI will need to be solved too.
This session covers AI governance. So far on this course we focused on technical alignment solutions. We also require strategic and political solutions to manage safe deployment of potential AGI systems, as well as dealing with new questions and risks arising from the existence of AGI.
Most of this week's resources focus on strategy research and field-building, not on developing, advocating or implementing specific policies. Relatively little work has been done in policy implementation, and we prefer to cover the principles of AI governance. Read more about the distinction between strategy and implementation here.
<https://forum.effectivealtruism.org/posts/ydpo7LcJWhrr2GJrx/the-longtermist-ai-governance-landscape-a-basic-overview> 
We are unable to achieve much depth in just 1 week; those interested in exploring AI governance in more detail, including evaluating individual policies, should look at our curriculum for the AI Governance course.
We also note that the field of AI governance is much broader than what we will cover this week. We'll focus specifically on new considerations that might need to be made due to the development of advanced AI systems. There are existing tangible harms posed by existing AI systems (which may well be exacerbated by more powerful systems) that also imply a need for AI governance, which we won't cover explicitly.

By the end of the unit, you should be able to:
\- Explain and evaluate the risks involved in deploying advanced AI systems
\- Explore the perspectives of stakeholders who make high-stakes AI decisions.
\- Explain why the following topics may be important for the governance of advanced AI 
    \- Compute governance
    \- Information security
    \- Model evaluation (also termed 'Standards and Monitoring')


AI Alignment (2023)

Exercises: Governance (Alignment 23)