forum.alglib.net

ALGLIB forum
It is currently Thu Mar 28, 2024 7:44 pm

All times are UTC


Forum rules


1. This forum can be used for discussion of both ALGLIB-related and general numerical analysis questions
2. This forum is English-only - postings in other languages will be removed.



Post new topic Reply to topic  [ 2 posts ] 
Author Message
 Post subject: Is it possible that Levenberg-Marquardt diverge?
PostPosted: Mon Oct 03, 2016 4:27 am 
Offline

Joined: Mon Oct 03, 2016 4:08 am
Posts: 1
The initial error is equal to: 0.543069
initial : 3.24471 0.0139718 1.96844 0.122383 0.00133655 1.82665 0.186222 0.716155 -0.704203 0.0360381 Exist type is: 5

The final solution is: [3.128,0.073,2.000,-0.348,0.032,1.649,0.041,0.741,-0.990,0.015]
The final error is equal to : 3571.43

After using the Levenberg-Marquardt algorithm, I got a worse answer. How could this happen? Maybe I got the jac matrix wrong? I just want to understand the reason behind it.


Top
 Profile  
 
 Post subject: Re: Is it possible that Levenberg-Marquardt diverge?
PostPosted: Tue Oct 04, 2016 11:51 am 
Offline
Site Admin

Joined: Fri May 07, 2010 7:06 am
Posts: 903
How do you define "error" - as "error in parameters" or "sum of squared function values"? LM performs minimization of squared sum of functions, and this metric must decrease at every step. Algorithm is designed in such way that it can not increase this metric.

From the other side - it is possible to get solution which is far away from desired one, whilst still minimizing squared sum. Say, you may have degenerate, ill-conditioned optimization problem with non-unique solution.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 2 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 59 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group