Hessian and Jacobian Matrix

Hessian Matrix

“We can use Hessian to find out how big a step we need to make from our current point to the point of minima or maxima, depending on the sign of the Hessian (i.e. the determinant of the Hessian matrix). By repeatedly performing an update that takes into account the inverse of the Hessian matrix, one can reach the local minimum/maximum. the update looks like:
$\theta=\theta-\mathbf{H}^{-1} f'(\theta)$. “

Jacobian Matrix