Exploiting data compression in collective I/O techniques

Rosa Filgueira, David E. Singh, Juan C. Pichel, Jesús Carretero

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

This paper presents Two-Phase Compressed I/O (TPC I/O,) an optimization of the Two-Phase collective I/O technique from ROMIO, the most popular MPI-IO implementation. In order to reduce network traffic, TPC I/O employs LZO algorithm to compress and decompress exchanged data in the inter-node communication operations. The compression algorithm has been fully implemented in the MPI collective technique, allowing to dynamically use (or not) compression. Compared with Two-Phase I/O, Two-Phase Compressed I/O obtains important improvements in the overall execution time for many of the considered scenarios.

Original languageEnglish
Title of host publication2008 IEEE International Conference on Cluster Computing
PublisherIEEE
Pages479-485
Number of pages7
ISBN (Print)9781424426393
DOIs
Publication statusPublished - 31 Oct 2008
Event2008 IEEE International Conference on Cluster Computing - Tsukuba, Japan
Duration: 29 Sep 20081 Oct 2008

Conference

Conference2008 IEEE International Conference on Cluster Computing
Abbreviated titleICCC 2008
CountryJapan
CityTsukuba
Period29/09/081/10/08

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Signal Processing

Fingerprint Dive into the research topics of 'Exploiting data compression in collective I/O techniques'. Together they form a unique fingerprint.

Cite this