Enhancing productivity on heterogeneous supercomputers with task-based programming model

Adrien Roussel (1, 2) , Mickael Boichot (3, 4, 5, 6, 2) , Romain Pereira (2, 7) , Manuel Ferat (2, 6)

1 LIHPC - Laboratoire en Informatique Haute Performance pour le Calcul et la simulation
2 DAM/DIF - DAM Île-de-France
3 IP Paris - Institut Polytechnique de Paris
4 TSP - INF - Département Informatique
5 ACMES-SAMOVAR - Architecture, Cloud continuum, formal Models, artificial intElligence and Services in distributed computing
6 LICIIS - Laboratoire d'Informatique en Calcul Intensif et Image pour la Simulation
7 AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms

Heterogeneous supercomputers with GPUs are one of the best candidates to build Exascale machines. However, porting scientific applications with millions of lines of code lines is challenging. Data transfers/locality and exposing enough parallelism determine the maximum achievable performance on such systems. Thus porting efforts impose developers to rewrite parts of the application which is tedious and time-consuming and does not guarantee performances in all the cases. Being able to detect which parts can be expected to deliver performance gains on GPUs is therefore a major asset for developers. Moreover, task parallel programming model is a promising alternative to expose enough parallelism while allowing asynchronous execution between CPU and GPU. OpenMP 4.5 introduces the « target » directive to offload computation on GPU in a portable way. Target constructions are considered as explicit OpenMP task in the same way as for CPU but executed on GPU. In this work, we propose a methodology to detect the most profitable loops of an application that can be ported on GPU. While we have applied the detection part on several mini applications (LULESH, miniFE, XSBench and Quicksilver), we experimented the full methodology on LULESH through MPI+OpenMP task programming model with target directives. It relies on runtime modifications to enable overlapping of data transfers and kernel execution through tasks. This work has been integrated into the MPC framework, and has been validated on distributed heterogeneous system.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]; Informatique [cs]

Adrien Roussel, Mickael Boichot, Romain Pereira, Manuel Ferat. Enhancing productivity on heterogeneous supercomputers with task-based programming model. SIAM CSE 2023 - SIAM Conference on Computational Science and Engineering, Feb 2023, Amsterdam, Netherlands. ⟨cea-03994014⟩