Get Started

Tensor Operations

Tensors are the common language between data and deep learning. Every image, every sentence, every gradient flows through them.

90 minutesBuildPythonMembers

Learning Objectives

  • Implement a tensor class with shape, strides, reshape, transpose, and element-wise operations from scratch
  • Apply broadcasting rules to operate on tensors of different shapes without copying data
  • Write einsum expressions for dot products, matrix multiplications, outer products, and batched operations
  • Trace the exact tensor shapes through every step of multi-head attention