Informatics Report Series



Related Pages

Report (by Number) Index
Report (by Date) Index
Author Index
Institute Index

Title:Compiler Estimation of Load Imbalance Overhead in Speculative Parallelization
Authors: Jialin Dou ; Marcelo Cintra
Date:Sep 2004
Publication Title:Proceedings of PACT 2004 (International Conference on Parallel Architectures and Compilation Techniques)
Publisher:IEEE Computer Society
Publication Type:Conference Paper Publication Status:Published
Page Nos:203-214
Speculative parallelization is a technique that complements automatic compiler parallelization by allowing code sections that cannot be fully analyzed by the compiler to be aggresively executed in parallel. However, while speculative parallelization can potentially deliver significant speedups, several overheads associated with the technique limit these speedups in practice. This paper proposes a novel compiler model of speculative multithreaded execution that can be used to reason about the overheads and expected resulting performance gains, or losses, from speculative parallelization. This model is based on estimating the likely execution duration of threads, properly takes into account the scheduling restrictions of most speculative execution environments, and can include all speculative parallelization overheads. Also, different from heuristics that attempt to qualitatively estimate potentially "good" or "bad" sections for speculative multithreaded execution, this model allows the compiler to estimate the speedup or slowdown quantitatively. Such quantitative estimate can then be used by the compiler or run-time system to make more complex and educated tradeoff decisions. We use the proposed framework on a number of loops from a collection of SPEC benchmarks that suffer mainly from load imbalance and thread dispatch and commit overheads. Experimental results show that our framework can identify on average 68% of the loops that cause slowdowns and on average 97% of the loops that lead to speedups. In fact, our framework predicts the speedups or slowdowns with an error of less than 20% for an average of 44% of the loops across the benchamrks, and with an error of less than 50% for an average of 84% of the loops. Overall, our framework leads to a performance improvement of 5% on average, and as high as 38%, over a naive approach that attempts to speculatively parallelize all the loops considered.
Links To Paper
1st Link
Bibtex format
author = { Jialin Dou and Marcelo Cintra },
title = {Compiler Estimation of Load Imbalance Overhead in Speculative Parallelization},
book title = {Proceedings of PACT 2004 (International Conference on Parallel Architectures and Compilation Techniques)},
publisher = {IEEE Computer Society},
year = 2004,
month = {Sep},
pages = {203-214},
url = {},

Home : Publications : Report 

Please mail <> with any changes or corrections.
Unless explicitly stated otherwise, all material is copyright The University of Edinburgh