Title :
Explicit loop scheduling in OpenMP for parallel automatic differentiation
Author :
Bucker, Martin H. ; Lang, Bruno ; Rasch, Arno ; Bischof, Christian H. ; Mey, Dieter An
Author_Institution :
Inst. for Sci. Comput., Aachen Univ. of Technol., Germany
Abstract :
Derivatives of almost arbitrary functions can be evaluated efficiently by automatic differentiation whenever the functions are given in the form of computer programs in a high-level programming language such as Fortran, C, or C++. In contrast to numerical differentiation, where derivatives are only approximated, automatic differentiation generates derivatives that are accurate up to machine precision. Sophisticated software tools implementing the technology of automatic differentiation are capable of automatically generating code for the product of the Jacobian matrix and a so-called seed matrix. It is shown how these tools can benefit from concepts of shared memory programming to parallelize, in a completely mechanical fashion, the gradient operations associated with each statement of the given code. The feasibility of our approach is demonstrated by numerical experiments. They were performed with a code that was generated automatically by the Adifor system and augmented with OpenMP directives.
Keywords :
differentiation; parallel programming; Adifor system; almost arbitrary functions; automatic differentiation; numerical algorithms; parallel computing; shared memory programming; Differential equations; Inverse problems; Jacobian matrices; Nonlinear equations; Parallel processing; Parallel programming; Partial differential equations; Pervasive computing; Processor scheduling; Scientific computing;
Conference_Titel :
High Performance Computing Systems and Applications, 2002. Proceedings. 16th Annual International Symposium on
Print_ISBN :
0-7695-1626-2
DOI :
10.1109/HPCSA.2002.1019144