Resources: Foundations of AI Governance

Exercises: Foundations of AI Governance

Resources: The AI Policy Toolkit

Exercises: The AI Policy Toolkit

Resources: How AI Systems Work

Exercises: How AI Systems Work

Resources: Proposals to Govern AI

Exercises: Proposals to Govern AI

Resources: The Promise and Perils of AI

Exercises: The Promise and Perils of AI

Resources: Contributing to AI Governance

Exercises: Contributing to AI Governance

Resources: How AI is Governed Today

Exercises: How AI is Governed Today

Resources: Governance at Frontier AI Companies

Exercises: Governance at Frontier AI Companies

In this unit, we'll zoom in on how frontier AI labs are approaching safety and responsible development. These companies, at the cutting edge of AI capabilities, are experimenting with novel approaches to corporate governance and self-regulation.

A key focus will be Responsible Scaling Policies (RSPs) - frameworks that labs use to evaluate and manage risks as they advance AI capabilities. These policies represent an attempt at industrial self-regulation, but their effectiveness and limitations are hotly debated. We'll examine both traditional and nontraditional corporate structures, exploring how different organizational models might influence safety outcomes.

Remember that corporate governance frameworks reflect specific organizational priorities and constraints. As you analyze these approaches, consider the inherent tensions between innovation, safety, and commercial pressures, and how different organizational structures might help or hinder managing these tradeoffs.

By the end of the unit, you should be able to:
\- Analyze how frontier AI labs govern themselves through both organizational structure and internal policies
\- Evaluate the strengths and limitations of Responsible Scaling Policies as a safety tool
\- Explore other ways frontier AI labs play a role in AI safety


_Spend 30-45 minutes on this exercise_
Review the responsible scaling policy of one of the following frontier labs:
- [OpenAI: Preparedness Framework](https://cdn.openai.com/openai-preparedness-framework-beta.pdf)
- [Anthropic: Responsible Scaling Policy](https://assets.anthropic.com/m/24a47b00f10301cd/original/Anthropic-Responsible-Scaling-Policy-2024-10-15.pdf)
- [DeepMind: Frontier Safety Framework](https://deepmind.google/discover/blog/updating-the-frontier-safety-framework/)
- [Meta Frontier AI Framework](https://ai.meta.com/static-resource/meta-frontier-ai-framework/)

Then, answer the following questions:
1. What risks is this policy addressing?
2. In your opinion, will this policy effectively mitigate those risks? If yes, why? If not, what makes it insufficient?


Review an RSP

AI Governance (2024)

See how the most powerful AI companies are setting their internal rules.

Governance at Frontier AI Companies

Learn the basics of AI: what it is, how it's trained, and what it's capable of.

How AI Systems Work

Understand the potential benefits and risks of advanced AI systems

The Promise and Perils of AI

Learn why AI governance matters, who the players are, and what technical factors shape our choices.

Foundations of AI Governance

Discover the concrete tools governments can use to steer AI and the hard tradeoffs they face.

The AI Policy Toolkit

Explore how the US, EU, and China are actually governing AI through eight types of regulation.

How AI is Governed Today

Examine concrete proposals for future AI governance, from compute governance to defensive acceleration.

Proposals to Govern AI

Learn how you can contribute to AI governance