Linear algebra for LLMs

Exactly the linear algebra you need to read a transformer: vectors, dot products, matrix multiplication, shapes, rank and rotations, each drawn, animated and tied to where it appears in an LLM. It is the background for Transformers.

Vectors

Matrices

Shapes and sizes

Structure