The Levenberg-Marquardt method requires inverting the approximate Hessian J^T*J (J = jacobian). In most cases where J has full column rank, the Hessian has full rank and the inverse exist. However, what if the approximated Hessian has poor condition number (i.e. the ratio between the largest and smallest singular value is greater, say, 1e6?) The solution of the decent direction is highly sensitive to data if the condition number if big. Doe the Levenberg-Marquardt method in ALGLIB has some kind of conditioning mechanism to ease this problem?
|