Gradient Descent - Constant Learning Rate

Overview


The simplest gradient step size is a constant size. This can be interpreted i
see Sayed pg 381

Intuition


{% \vec{ \theta_{k+1} } = \vec{ \theta_k } - \nu \vec{g_k} %}

Contents