Skip to Main content Skip to Navigation
Conference papers

Benefits of MPI Sessions for GPU MPI applications

Abstract : Heterogeneous supercomputers are now considered the most valuable solution to reach the Exascale. Nowadays, we can frequently observe that compute nodes are composed of more than one GPU accelerator. Programming such architectures efficiently is challenging. MPI is the defacto standard for distributed computing. CUDAaware libraries were introduced to ease GPU inter-nodes communications. However, they induce some overhead that can degrade overall performances. MPI 4.0 Specification draft introduces the MPI Sessions model which offers the ability to initialize specific resources for a specific component of the application. In this paper, we present a way to reduce the overhead induced by CUDA-aware libraries with a solution inspired by MPI Sessions. In this way, we minimize the overhead induced by GPUs in an MPI context and allow to improve CPU + GPU programs efficiency. We evaluate our approach on various micro-benchmarks and some proxy applications like Lulesh, MiniFE, Quicksilver, and Cloverleaf. We demonstrate how this approach can provide up to a 7x speedup compared to the standard MPI model.
Complete list of metadata
Contributor : Adrien Roussel Connect in order to contact the contributor
Submitted on : Friday, August 20, 2021 - 9:46:12 AM
Last modification on : Monday, December 13, 2021 - 9:17:36 AM
Long-term archiving on: : Sunday, November 21, 2021 - 6:11:04 PM


Files produced by the author(s)




Maxim Moraru, Adrien Roussel, Marc Pérache, Hugo Taboada, Christophe Jaillet, et al.. Benefits of MPI Sessions for GPU MPI applications. EuroMPI '21 - 28th European MPI Users' Group Meeting, Sep 2021, Leibniz, Germany. ⟨10.1145/1122445.1122456⟩. ⟨cea-03322976⟩



Record views


Files downloads