Applying selectively parallel I/O compression to parallel storage systems

Rosa Filgueira, Malcolm Atkinson, Yusuke Tanimura, Isao Kojima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

This paper presents a new I/O technique called Selectively Parallel I/O Compression (SPIOC) for providing high-speed storage and access to data in QoS enabled parallel storage systems. SPIOC reduces the time of I/O operations by applying transparent compression between the computing and the storage systems. SPIOC can predict whether to compress or not at runtime, allowing parallel or sequential compression techniques, guaranteeing QoS and allowing partial and full reading by decompressing the minimum part of the file. SPIOC maximises the measured efficiency of data movement by applying run-time customising compression before storing data in the Papio storage system.

Original languageEnglish
Title of host publicationEuro-Par 2014 Parallel Processing. Euro-Par 2014
EditorsFernando Silva, Inês Dutra, Vítor Santos Costa
PublisherSpringer
Pages282-293
Number of pages12
ISBN (Electronic)9783319098739
ISBN (Print)9783319098722
DOIs
Publication statusPublished - 2014
Event20th International Conference on Parallel Processing 2014 - Porto, Portugal
Duration: 25 Aug 201429 Aug 2014

Publication series

NameLecture Notes in Computer Science
Volume8632
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th International Conference on Parallel Processing 2014
Abbreviated titleEuro-Par 2014
Country/TerritoryPortugal
CityPorto
Period25/08/1429/08/14

Keywords

  • Adaptive systems
  • Compression algorithms
  • Data Intensive Computing
  • Parallel File System

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Applying selectively parallel I/O compression to parallel storage systems'. Together they form a unique fingerprint.

Cite this