Link Search Menu Expand Document

Now we have only first order information from the oracle.

Stochastic gradient algorithms

Due to theire computational efficiency, stochastic first order algorithms remains cornerstone of modern huge scale deep learning.

Visualisations

Rosenbrock Function

Materials


Table of contents