Projection methods for linear systems

The aim of this paper is, first, to give a unified framework for deriving several known projection methods for solving systems of linear equations. We shall show that all these methods follow from a unique minimization problem. The particular cases of the methods of steepest descent, Richardson and conjugate gradients will be treated in details. Then, projection acceleration procedures for accelerating the convergence of an arbitrary iterative method will also be proposed and discussed.