All topics

Topic

Deep Learning

Optimisation, architectures, and the geometry underneath them — why the training loop does what it does.

/2 min read

The Geometry of Gradient Descent

Why the negative gradient is the direction of steepest descent — and what the learning rate is really controlling.

  • optimization
  • calculus
  • machine-learning