AI Knowledge Tree

A1Linear algebra

17 lessons. Study in order; each one assumes the previous.

Linear algebra is the language of data once you stack it into vectors and matrices. Almost everything downstream, from a least-squares fit to a transformer's attention block, is some arrangement of linear maps acting on high-dimensional points, so this discipline is where you learn to see those operations clearly instead of as opaque tensor shapes.

You will build from vector spaces, bases, and the four fundamental subspaces up through eigenvalues, the spectral theorem, and the singular value decomposition, then put them to work: low-rank approximation and PCA, the LU/QR/Cholesky factorizations that solve linear systems without inverting anything, least squares and the pseudo-inverse, and the matrix calculus and einsum notation that make backpropagation just the chain rule on arrays. By the end you can decompose a matrix, reason about why a system is solvable, and differentiate vector-valued expressions by hand.

This is the most reused pillar in the tree. PCA, recommender factorizations, the geometry of embeddings, and the entire training loop of deep networks all rest on what you build here, so fluency now pays off in every later subject.

Before you start

  • High-school algebra and trigonometry; comfort manipulating symbolic expressions.
  • Single-variable calculus: derivatives and the chain rule (taught from scratch in L2).
  • Basic Python with numpy (arrays, indexing); vectors and matrices are rebuilt from scratch here.
Start with lesson 1: Vector spaces & subspaces →