Title :
Speculative Parallelization in Decoupled Look-ahead
Author :
Garg, Alok ; Parihar, Raj ; Huang, Michael C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Rochester, Rochester, NY, USA
Abstract :
While a canonical out-of-order engine can effectively exploit implicit parallelism in sequential programs, its effectiveness is often hindered by instruction and data supply imperfections manifested as branch mispredictions and cache misses. Accurate and deep look-ahead guided by a slice of the executed program is a simple yet effective approach to mitigate the performance impact of branch mispredictions and cache misses. Unfortunately, program slice-guided look ahead is often limited by the speed of the look-ahead code slice, especially for irregular programs. In this paper, we attempt to speed up the look-ahead agent using speculative parallelization, which is especially suited for the task. First, slicing for look-ahead tends to reduce important data dependences that prohibit successful speculative parallelization. Second, the task for look-ahead is not correctness critical and thus naturally tolerates dependence violations. This enables an implementation to forgo violation detection altogether, simplifying architectural support tremendously. In a straightforward implementation, incorporating speculative parallelization to the look-ahead agent further improves system performance by up to 1.39x with an average of 1.13x.
Keywords :
cache storage; parallel processing; program slicing; branch misprediction; cache misses; canonical out-of-order engine; data dependence reduction; decoupled look-ahead; implicit parallelism; look-ahead agent; look-ahead code slice; program slice-guided look ahead; sequential program; speculative parallelization; violation detection; Hardware; Parallel processing; Prefetching; Silicon; Skeleton; Decoupled look-ahead; Helper-threading; Microarchitecture; Speculative parallelization;
Conference_Titel :
Parallel Architectures and Compilation Techniques (PACT), 2011 International Conference on
Conference_Location :
Galveston, TX
Print_ISBN :
978-1-4577-1794-9
DOI :
10.1109/PACT.2011.72