Get Started

Sampling Methods

Sampling is how AI explores the space of possibilities.

120 minutesBuildPythonMembers

Learning Objectives

  • Implement inverse CDF, rejection, and importance sampling from scratch using only uniform random numbers
  • Build temperature, top-k, and top-p (nucleus) sampling for language model token generation
  • Explain the reparameterization trick and why it enables backpropagation through sampling in VAEs
  • Run Metropolis-Hastings MCMC to sample from an unnormalized target distribution