Solving triangular linear systems in parallel using substitution

Working within the LogP model, we present parallel triangular solvers which use forward/backward substitution and show that they are optimal. We begin by deriving several lower bounds on execution time for solving triangular linear systems. Specifically, we derive lower bounds in which it is assumed that the number of data items per processor is bounded, a general lower bound, and lower bounds for specific data layouts commonly used for this problem. Furthermore, algorithms are provided which have running times within a constant factor of the lower bounds described. One interesting result is that the popular 2-dimensional block matrix layout necessarily results in significantly longer running times than simpler one-dimensional schemes. Finally, we present a generalization of the lower bounds to banded triangular linear systems