CoMPI: Enhancing MPI based applications performance and scalability using run-time compression

Rosa Filgueira, David E. Singh, Alejandro Calderón, Jesús Carretero

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

This paper presents an optimization of MPI communications, called CoMPI, based on run-time compression of MPI messages exchanged by applications. A broad number of compression algorithms have been fully implemented and tested for both MPI collective and point to point primitives. In addition, this paper presents a study of several compression algorithms that can be used for run-time compression, based on the datatype used by applications. This study has been validated by using several MPI benchmarks and real HPC applications. Show that, in most of the cases, using compression reduces the application communication time enhancing application performance and scalability. In this way, CoMPI obtains important improvements in the overall execution time for many of the considered scenarios.

Original languageEnglish
Title of host publicationRecent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2009
EditorsM. Ropo, J. Westerholm, J. Dongarra
PublisherSpringer
Pages207-218
Number of pages12
ISBN (Electronic)9783642037702
ISBN (Print)9783642037696
DOIs
Publication statusPublished - 2009
Event16th European Parallel Virtual Machine and Message Passing Interface Users' Group Meeting 2009 - Espoo, Finland
Duration: 7 Sep 200910 Sep 2009

Publication series

NameLecture Notes in Computer Science
Volume5759
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th European Parallel Virtual Machine and Message Passing Interface Users' Group Meeting 2009
Abbreviated titleEuroPVM/MPI 2009
CountryFinland
CityEspoo
Period7/09/0910/09/09

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'CoMPI: Enhancing MPI based applications performance and scalability using run-time compression'. Together they form a unique fingerprint.

Cite this