#gradient-descent

Gradient descent: learning rate is everything

A one-parameter playground for the algorithm that trains every neural network, and a feel for when it diverges.