Resources: Reinforcement Learning

Exercises: Reinforcement Learning

Resources: Capstone Project

Exercises: Capstone Project

Resources: Transformers and Mechanistic Interpretability

Exercises: Transformers and Mechanistic Interpretability

Resources: Fundamentals

Exercises: Fundamentals

Resources: Prerequisites

Exercises: Prerequisites

Here you can find all the prerequisites needed for completing the course. In advance of  The first page Core Concepts / Knowledge is a long list of important concepts and libraries that you should be familiar with before starting the rest of the material. The second page Einops, Einsum & Tensor Manipulation provides some coding exercises to help you get familiar with the einops and einsum libraries, as well as some exercises on indexing and other aspects of tensor manipulation. 

This page contains a list of all prerequisites we think will be helpful to learn before studying the program material. You can return to this page while you study. None of it is compulsory and some resources are likely to be much more helpful than others. We denote very high and high-priority resources with a double and single asterisk respectively, so if you have limited time then prioritise these. It is strongly recommended to at least read over everything with a double asterisk.

By the end of the unit, you should be able to:
Before the program begins, you should be able to 
\- Understand the basics of Einstein summation convention
\- Learn how to use einops to perform basic tensor rearrangement, and einsum to to perform standard linear algebra operations on tensors
\- Be confident in your familiarity with the math and coding related concepts that are necessary to complete the rest of the course. 


ARENA

Resources: Prerequisites

Resources