Deep Learning
Gradient Descent
The workhorse of training neural nets. Set a learning rate and a starting point, then watch the parameter roll downhill — converge, oscillate, or diverge.
Iteration0
x—
loss f(x)—
gradient—
The workhorse of training neural nets. Set a learning rate and a starting point, then watch the parameter roll downhill — converge, oscillate, or diverge.