• DocumentCode
    827965
  • Title

    A scheme for determining stepsizes for unconstrained optimization methods

  • Author

    Mukai, H.

  • Author_Institution
    Washington University, St. Louis, MO, USA
  • Volume
    23
  • Issue
    6
  • fYear
    1978
  • fDate
    12/1/1978 12:00:00 AM
  • Firstpage
    987
  • Lastpage
    995
  • Abstract
    We present a new scheme for determining stepsizes for iterative unconstrained minimization methods. This scheme provides a stepsize estimate for the efficient Armijo-type stepsize determination rule and improves its performance. As examples for the new scheme, we also present a new gradient algorithm and a new conjugate gradient algorithm. These two algorithms are readily implementable and eventually demand only one trial stepsize at each iteration. Their global convergence is established without any convexity assumptions. The convergence ratio associated with the gradient algorithm is shown to converge to the canonical convergence ratio (that is, the best possible convergence ratio). The convergence rate of the conjugate gradient algorithm is n-step superlinear and n-step quadratic.
  • Keywords
    Gradient methods; Optimization methods; Convergence; Gradient methods; Interpolation; Iterative algorithms; Iterative methods; Minimization methods; Newton method; Optimization methods; Testing;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/TAC.1978.1101903
  • Filename
    1101903