| forum.alglib.net http://forum.alglib.net/ |
|
| How exatly are parameter scales used in minnlc? http://forum.alglib.net/viewtopic.php?f=2&t=4602 |
Page 1 of 1 |
| Author: | mfabjancic [ Tue May 07, 2024 12:12 pm ] |
| Post subject: | How exatly are parameter scales used in minnlc? |
Hi, I have been experimenting with the minnlc optimizer (the SQP algorithm, set with minnlcsetalgosqp). The documentation states that the scaling coefficients set with minnlcsetscale are used to test stopping conditions, and when using numerical differentiation. My problem has an analytical gradient, so as per the documentation, the scaling coefficients shall only affect stopping conditions. I presume these stopping conditions will come into effect when the optimizer will be doing some kind of line search internally. Is the minnlcsetscale documentation accurate? Are the scaling coefficients really used only to test stopping conditions, or does the SQP solver do any kind of preconditioning based on these scaling coefficients? Thanks, Matevž |
|
| Author: | Sergey.Bochkanov [ Tue May 07, 2024 4:29 pm ] |
| Post subject: | Re: How exatly are parameter scales used in minnlc? |
Hi! Yes, you are right and the documentation is not exactly accurate here. The SQP solver also uses scales for preconditioning. In particular, internal quasi-Newton SR1 update uses inverted squared variable scales as an "initial" diagonal matrix for the update. I have fixed the documentation, the upcoming 4.02 release (will be in several days, a week at most) will feature it. Sergey. |
|
| Author: | mfabjancic [ Wed May 08, 2024 1:30 pm ] |
| Post subject: | Re: How exatly are parameter scales used in minnlc? |
Thanks! |
|
| Page 1 of 1 | All times are UTC |
| Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group http://www.phpbb.com/ |
|