Skip to Main content Skip to Navigation
Conference papers

Benefits of MPI Sessions for GPU MPI applications

Abstract : Heterogeneous supercomputers are now considered the most valuable solution to reach the Exascale. Nowadays, we can frequently observe that compute nodes are composed of more than one GPU accelerator. Programming such architectures efficiently is challenging. MPI is the defacto standard for distributed computing. CUDAaware libraries were introduced to ease GPU inter-nodes communications. However, they induce some overhead that can degrade overall performances. MPI 4.0 Specification draft introduces the MPI Sessions model which offers the ability to initialize specific resources for a specific component of the application. In this paper, we present a way to reduce the overhead induced by CUDA-aware libraries with a solution inspired by MPI Sessions. In this way, we minimize the overhead induced by GPUs in an MPI context and allow to improve CPU + GPU programs efficiency. We evaluate our approach on various micro-benchmarks and some proxy applications like Lulesh, MiniFE, Quicksilver, and Cloverleaf. We demonstrate how this approach can provide up to a 7x speedup compared to the standard MPI model.
Complete list of metadata

https://hal-cea.archives-ouvertes.fr/cea-03322976
Contributor : Adrien Roussel Connect in order to contact the contributor
Submitted on : Friday, August 20, 2021 - 9:46:12 AM
Last modification on : Thursday, October 14, 2021 - 1:10:15 PM
Long-term archiving on: : Sunday, November 21, 2021 - 6:11:04 PM

File

gpu_mpi_sessions.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Maxim Moraru, Adrien Roussel, Marc Pérache, Hugo Taboada, Christophe Jaillet, et al.. Benefits of MPI Sessions for GPU MPI applications. EuroMPI '21 - 28th European MPI Users' Group Meeting, Sep 2021, Leibniz, Germany. ⟨10.1145/1122445.1122456⟩. ⟨cea-03322976⟩

Share

Metrics

Record views

114

Files downloads

61