Quasi-Newton Method

A nonlinear estimation procedure that will, at each step, evaluate the function at different points in order to estimate the first-order derivatives and second-order derivatives. It will then use this information to follow a path toward the minimum of the loss function. For more details, see Quasi-Newton Method.