/2 min read
The Geometry of Gradient Descent
Why the negative gradient is the direction of steepest descent — and what the learning rate is really controlling.
- optimization
- calculus
- machine-learning
Topic
Optimisation, architectures, and the geometry underneath them — why the training loop does what it does.
Why the negative gradient is the direction of steepest descent — and what the learning rate is really controlling.