Poster: Reservation-Based I/O Performance Guarantee for MPI-IO Applications Using Shared Storage Systems

Yusuke Tanimura, Rosa Filgueira, Isao Kojima, Malcolm Atkinson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While optimized collective I/O methods are proposed for MPI-IO implementations, a problem in concurrent use of the shared storage system is raised. In order to prevent performance degradation of parallel I/O due to such I/O conflict, we propose an advance reservation approach, including possible integration with existing batch scheduler on HPC clusters. In this work, we use Dynamic-CoMPI as a MPI-IO implementation and Papio as a shared storage system which implements parallel I/O and performance reservation. Then we have been developing the ADIO layer to connect these systems and to evaluate the benefits of the reservation-based performance isolation. Our prototype implementation, Dynamic-CoMPI/Papio, was evaluated using the MPI-IO Test benchmark and the BISP3D application. In our preliminary evaluation, total execution time increased 3~12% with the Dynamic-CoMPI/PVFS2 and 6~40% with the Dynamic-CoMPI/Lustre, under the situation where additional workload affected on MPI execution, however there was no obvious time increase with Dynamic-CoMPI/Papio.
Original languageEnglish
Title of host publication2012 SC Companion: High Performance Computing, Networking Storage and Analysis
PublisherIEEE
ISBN (Electronic)9780769549569
ISBN (Print)9781467362184
DOIs
Publication statusPublished - 11 Apr 2013

Fingerprint Dive into the research topics of 'Poster: Reservation-Based I/O Performance Guarantee for MPI-IO Applications Using Shared Storage Systems'. Together they form a unique fingerprint.

Cite this