Exploiting data compression in collective I/O techniques

Rosa Filgueira*, David E. Singh, Juan C. Pichel, Jesús Carretero

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)


This paper presents Two-Phase Compressed I/O (TPC I/O,) an optimization of the Two-Phase collective I/O technique from ROMIO, the most popular MPI-IO implementation. In order to reduce network traffic, TPC I/O employs LZO algorithm to compress and decompress exchanged data in the inter-node communication operations. The compression algorithm has been fully implemented in the MPI collective technique, allowing to dynamically use (or not) compression. Compared with Two-Phase I/O, Two-Phase Compressed I/O obtains important improvements in the overall execution time for many of the considered scenarios.

Original languageEnglish
Title of host publication2008 IEEE International Conference on Cluster Computing
Number of pages7
ISBN (Print)9781424426393
Publication statusPublished - 31 Oct 2008
Event2008 IEEE International Conference on Cluster Computing - Tsukuba, Japan
Duration: 29 Sept 20081 Oct 2008


Conference2008 IEEE International Conference on Cluster Computing
Abbreviated titleICCC 2008

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Signal Processing


Dive into the research topics of 'Exploiting data compression in collective I/O techniques'. Together they form a unique fingerprint.

Cite this