| forum.alglib.net http://forum.alglib.net/ |
|
| Gradient analytical form in ALGLIB optimization solver http://forum.alglib.net/viewtopic.php?f=2&t=172 |
Page 1 of 1 |
| Author: | amonlibert [ Tue Jan 18, 2011 3:56 pm ] |
| Post subject: | Gradient analytical form in ALGLIB optimization solver |
To run ALGLIB LBFGS optimisation solver, I noticed that we have to provide both the analytical function and its analytical gradient. But sometimes the analytical form of the gradient cannot always be calculated for some complex functions. To avoid such problem, we have to estimate the gradient through a four point formula computed through finite difference method. I think that it would be nice to have the possibility to ask LBFGS solver to estimate directly the gradiant in the core code when its analytical form is not provided. This could be applied to all ALGLIB optimisation solvers. What do you think? Kind regards, Antoine |
|
| Author: | Sergey.Bochkanov [ Wed Jan 19, 2011 3:25 pm ] |
| Post subject: | Re: Gradient analytical form in ALGLIB optimization solver |
I've thought about that, but there are exist difficulties associated with a) algorithm tolerance to errors in the gradient, and b) selection of proper differentiation step. For example, Levenberg-Marquardt allows moderate errors in the gradient, but CG requires precise gradient. I think that L-BFGS is somewhere between LM and CG, and it is worth a try. Maybe even in the future ALGLIB 3.3 - I plan to improve numerical optimization significantly, it may be worth addition. |
|
| Page 1 of 1 | All times are UTC |
| Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group http://www.phpbb.com/ |
|