_This project was one of the top submissions on the (Dec 2024) Writing Intensive course. The text below is an excerpt from the final project._

## Introduction

With state-of-the-art AI capable of [beating PhDs in all scientific domains](https://www.lesswrong.com/posts/XroTfXFSq3yeJgu73/we-are-in-a-new-paradigm-of-ai-progress-openai-s-o3-model), ranking in the [top 200 in competitive programming](https://x.com/deedydas/status/1870175212328608232) in the world and [achieving a silver medal](https://deepmind.google/discover/blog/ai-solves-imo-problems-at-silver-medal-level/) in the International Mathematical Olympiad, there's an urgent need to understand their internal decision-making processes. Mechanistic interpretability has emerged as a promising approach to address this opacity by attempting to reverse engineer the computational processes occurring within neural networks.

<Embed url="https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0537a11-5ada-44fa-a661-2f2dfaf590ea_1600x521.png" />

A user will ask an AI model a simple question like "What is the capital of France?" and subsequently output "Paris". How it leads to that output is largely unknown.

This article aims to synthesise the fundamentals of current mechanistic interpretability advances, with a focus on three approaches that together offer us the greatest insight into these models we've had yet:

1. The **circuits** framework for understanding feature composition
2. Theoretical models explaining the emergence of **superposition**
3. **Sparse autoencoders** (SAEs) as a practical tool for extracting interpretable features

This approach to alignment represents a fundamental shift in how we approach AI safety. Instead of treating AI systems as black boxes that we can only evaluate from the outside, we can begin to understand and modify the internal mechanisms that produce their behaviour. This is a key differentiator to other safety approaches like RLHF which focus on steering model outputs externally.

These recent advancements, I argue, present an important inflection point in mechanistic interpretability, where we can reliably move from theoretical possibility to a practical tool for controlling very capable AI.

## Full project

_View the full project [here](https://jackpayne856.substack.com/p/breaking-down-complexity-how-mechanistic)._


Breaking Down Complexity: How Mechanistic Interpretability Actually Works

Jack Payne • Top submission • January 2025