forum.alglib.net

ALGLIB forum
It is currently Thu Mar 28, 2024 2:53 pm

All times are UTC


Forum rules


1. This forum can be used for discussion of both ALGLIB-related and general numerical analysis questions
2. This forum is English-only - postings in other languages will be removed.



Post new topic Reply to topic  [ 3 posts ] 
Author Message
 Post subject: Scale in QP-BLEIC
PostPosted: Fri Aug 05, 2016 2:59 pm 
Offline

Joined: Fri Aug 05, 2016 11:48 am
Posts: 4
I am using the QP-BLEIC algorithm and it seems to work very well almost all the time.

From the documentation I gather that the scale is used in the termination criteria. Does it affect the algorithm in some other way?

Is multiplying the scales by a constant, equivalent to multiplying/dividing the gradient and step tolerances by the same constant (if the objective function tolerance is 0)?

The reason I ask is because I had issues with constraint violations on the order of 1e-4 for an equality constraint. The termination type was 4. I had set the scale to be the difference between lower and upper bound, about 1, although the magnitude of the actual solution was smaller than that. Somehow reducing the scale seems to help while reducing the tolerances did not. They were set to 1e-8. All variables have about the same scale.

The right hand side of the equality constraint is a very small number, about (1e-10). Does this matter?


Top
 Profile  
 
 Post subject: Re: Scale in QP-BLEIC
PostPosted: Mon Aug 08, 2016 12:52 pm 
Offline
Site Admin

Joined: Fri May 07, 2010 7:06 am
Posts: 903
Hello!

"Is multiplying the scales by a constant, equivalent to multiplying/dividing the gradient and step tolerances" - not equivalent. It changes tolerances in the way specified by you, but variable scales are used in multiple places.

Say, it used in constraint handling - if you have constraint violation of 1.e-10, you need some way of knowing whether it is significant violation or not. Reducing scale for variable makes algorithm less tolerant to constraint violation for this specific variable.

So, it seems that you spotted the right reason behind incorrect handling of constraints.


Top
 Profile  
 
 Post subject: Re: Scale in QP-BLEIC
PostPosted: Wed Aug 10, 2016 7:09 pm 
Offline

Joined: Fri Aug 05, 2016 11:48 am
Posts: 4
Hello again!

Thanks a lot. I have a few more questions:

Is the effect of the scale parameter the same as solving the problem transformed to new variables (so that each new variable is the original divided by the scale)?

Why do I sometimes get termination type 4 even though I have set zero tolerance for gradient?
What is the tolerance for the gradient in this case and is it possible that I get will get a difference from optimum that exceeds epsx (taking scale into account)?

Is the algorithm affected by changing the objective function or one of the constraint equations/inequalities by a constant?

How is the tolerance for constraint violations determined exactly?

Why do I get termination type 7 sometimes? What can I do about it?

Thanks!


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 3 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 59 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group