Data locality aware strategy for two-phase collective I/O

Rosa Filgueira*, David E. Singh, Juan C. Pichel, Florin Isaila, Jesús Carretero

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

This paper presents Locality-Aware Two-Phase (LATP) I/O, an optimization of the Two-Phase collective I/O technique from ROMIO, the most popular MPI-IO implementation. In order to increase the locality of the file accesses, LATP employs the Linear Assignment Problem (LAP) for finding an optimal distribution of data to processes, an aspect that is not considered in the original technique. This assignment is based on the local data that each process stores and has as main purpose the reduction of the number of communication involved in the I/O collective operation and, therefore, the improvement of the global execution time. Compared with Two-Phase I/O, LATP I/O obtains important improvements in most of the considered scenarios.

Original languageEnglish
Title of host publicationHigh Performance Computing for Computational Science. VECPAR 2008
EditorsJ. M. L. M. Palma, P. R. Amestoy , M. Daydé, M. Mattoso, J.C. Lopes
PublisherSpringer
Pages137-149
Number of pages13
ISBN (Electronic)9783540928591
ISBN (Print)9783540928584
DOIs
Publication statusPublished - 2008
Event8th International Conference on High Performance Computing for Computational Science 2008 - Toulouse, France
Duration: 24 Jun 200827 Jun 2008

Publication series

NameLecture Notes in Computer Science
Volume5336
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference8th International Conference on High Performance Computing for Computational Science 2008
Abbreviated titleVECPAR 2008
Country/TerritoryFrance
CityToulouse
Period24/06/0827/06/08

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Data locality aware strategy for two-phase collective I/O'. Together they form a unique fingerprint.

Cite this