Python Implementation of Gradient Descent
Implementations
Simple Code
The following code calculates the gradient descent of a function. It utilizes the gradient function defined at Python Implementation of Gradient
def gradient_descent_iterator(method):
def iterate(args, size):
rargs = [*args]
grad = gradient(method, args)
for i in range(len(args)):
rargs[i] -= size*grad[i]
return rargs
return iterate
def gradient_descent(method, args, iterations=1000, size=0.01):
iterator = gradient_descent_iterator(method)
for i in range(iterations):
args = iterator(args, size)
pass
return args