DocumentCode
827965
Title
A scheme for determining stepsizes for unconstrained optimization methods
Author
Mukai, H.
Author_Institution
Washington University, St. Louis, MO, USA
Volume
23
Issue
6
fYear
1978
fDate
12/1/1978 12:00:00 AM
Firstpage
987
Lastpage
995
Abstract
We present a new scheme for determining stepsizes for iterative unconstrained minimization methods. This scheme provides a stepsize estimate for the efficient Armijo-type stepsize determination rule and improves its performance. As examples for the new scheme, we also present a new gradient algorithm and a new conjugate gradient algorithm. These two algorithms are readily implementable and eventually demand only one trial stepsize at each iteration. Their global convergence is established without any convexity assumptions. The convergence ratio associated with the gradient algorithm is shown to converge to the canonical convergence ratio (that is, the best possible convergence ratio). The convergence rate of the conjugate gradient algorithm is n-step superlinear and n-step quadratic.
Keywords
Gradient methods; Optimization methods; Convergence; Gradient methods; Interpolation; Iterative algorithms; Iterative methods; Minimization methods; Newton method; Optimization methods; Testing;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/TAC.1978.1101903
Filename
1101903
Link To Document