Linear Systems
Solving $Ax = b$ is the oldest problem in mathematics that still runs your neural network.
120 minutesBuildPythonMembers
Learning Objectives
- Solve $Ax = b$ using Gaussian elimination with partial pivoting and back substitution
- Factor matrices with LU, QR, and Cholesky decompositions and explain when each is appropriate
- Derive the normal equations for least squares and connect them to linear and ridge regression
- Diagnose ill-conditioned systems using the condition number and apply regularization to stabilize them