davinci-net.
Share Brilliantly
optimization
Gradient Descent - Constant Learning Rate
Overview
The simplest gradient step size is a constant size. This can be interpreted i
see
Sayed
pg 381
Intuition
{% \vec{ \theta_{k+1} } = \vec{ \theta_k } - \nu \vec{g_k} %}
Contents