Skip to Main content Skip to Navigation
Conference papers

Exploiting system level heterogeneity to improve the performance of a GeoStatistics multi-phase task-based application

Abstract : Heterogeneity is part of HPC infrastructures, not only at the intranode but at the system level. Applications with multiple phases with distinct resource necessities can take advantage of this internode heterogeneity to improve performance and reduce resource idleness. Such an application is ExaGeoStat, a task-based machine learning framework specifically designed for geostatistics data. This work presents strategies to efficiently distribute multi-phase applications in system-level heterogeneous resources. We both (1) improve application phase overlap by optimizing runtime and scheduling decisions and (2) compute the optimal distribution for all the phases using a linear program leveraging node heterogeneity while limiting communication overhead. The performance gains of our phase overlap improvements are between 36% and 50% compared to the original base synchronous and homogeneous execution. We show that by adding some slow nodes to a homogeneous set of fast nodes, we can improve the performance by another 25% compared to a standard block-cyclic distribution, thereby harnessing any machine. CCS CONCEPTS • Computing methodologies → Massively parallel algorithms; Distributed computing methodologies.
Complete list of metadata

https://hal.inria.fr/hal-03280459
Contributor : Arnaud Legrand <>
Submitted on : Friday, July 16, 2021 - 9:07:28 AM
Last modification on : Wednesday, July 21, 2021 - 1:35:18 PM

File

ICPP.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Lucas Nesi, Arnaud Legrand, Lucas Mello Schnorr. Exploiting system level heterogeneity to improve the performance of a GeoStatistics multi-phase task-based application. ICPP 2021 - 50th International Conference on Parallel Processing, Aug 2021, Lemont, United States. pp.1-10, ⟨10.1145/3472456.3472516⟩. ⟨hal-03280459⟩

Share

Metrics

Record views

78

Files downloads

208