Question

What is gradient descent?

Answer 1

Gradient descent is an optimization algorithm used to minimize the cost function in machine learning.

Answer 2

Gradient descent is an optimization algorithm used to find the values of parameters (coefficients) of a function (f) that minimizes a cost function (cost).

Gradient descent is best used when the parameters cannot be calculated analytically (e.g. using linear algebra) and must be searched for by an optimization algorithm.