Automating environmental computing applications with scientific workflows

Rafael Ferreira Da Silva; Ewa Deelman; Rosa Filgueira; Karan Vahi; Mats Rynge; Rajiv Mayani; Benjamin Mayer

doi:10.1109/eScience.2016.7870926

Automating environmental computing applications with scientific workflows

Rafael Ferreira Da Silva, Ewa Deelman, Rosa Filgueira, Karan Vahi, Mats Rynge, Rajiv Mayani, Benjamin Mayer

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

13 Citations (Scopus)

Abstract

Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.

Original language	English
Title of host publication	2016 IEEE 12th International Conference on e-Science (e-Science)
Publisher	IEEE
Pages	400-406
Number of pages	7
ISBN (Electronic)	9781509042739
DOIs	https://doi.org/10.1109/eScience.2016.7870926
Publication status	Published - 6 Mar 2017
Event	12th IEEE International Conference on e-Science 2016 - Baltimore, United States Duration: 23 Oct 2016 → 27 Oct 2016

Conference

Conference	12th IEEE International Conference on e-Science 2016
Abbreviated title	e-Science 2016
Country/Territory	United States
City	Baltimore
Period	23/10/16 → 27/10/16

Keywords

Environmental Computing
Pegasus Workflow Management System
Scientific workflows

ASJC Scopus subject areas

Computer Networks and Communications
Information Systems
Environmental Science (miscellaneous)
Medicine (miscellaneous)
Social Sciences (miscellaneous)
Agricultural and Biological Sciences (miscellaneous)
Computer Science Applications

Access to Document

10.1109/eScience.2016.7870926

Cite this

@inproceedings{7a228c130890416890a923b35d22471c,

title = "Automating environmental computing applications with scientific workflows",

abstract = "Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.",

keywords = "Environmental Computing, Pegasus Workflow Management System, Scientific workflows",

author = "{Da Silva}, {Rafael Ferreira} and Ewa Deelman and Rosa Filgueira and Karan Vahi and Mats Rynge and Rajiv Mayani and Benjamin Mayer",

note = "Funding Information: This work was funded by DOE under the contract number #DESC0012636, {"}Panorama-Predictive Modeling and Diagnostic Monitoring of Extreme Science Workflows{"}; and by the National Science Foundation under the SI2-SSI program, award number 1148515. Publisher Copyright: {\textcopyright} 2016 IEEE.; 12th IEEE International Conference on e-Science 2016, e-Science 2016 ; Conference date: 23-10-2016 Through 27-10-2016",

year = "2017",

month = mar,

day = "6",

doi = "10.1109/eScience.2016.7870926",

language = "English",

pages = "400--406",

booktitle = "2016 IEEE 12th International Conference on e-Science (e-Science)",

publisher = "IEEE",

address = "United States",

}

Da Silva, RF, Deelman, E, Filgueira, R, Vahi, K, Rynge, M, Mayani, R & Mayer, B 2017, Automating environmental computing applications with scientific workflows. in 2016 IEEE 12th International Conference on e-Science (e-Science). IEEE, pp. 400-406, 12th IEEE International Conference on e-Science 2016, Baltimore, Maryland, United States, 23/10/16. https://doi.org/10.1109/eScience.2016.7870926

TY - GEN

T1 - Automating environmental computing applications with scientific workflows

AU - Da Silva, Rafael Ferreira

AU - Deelman, Ewa

AU - Filgueira, Rosa

AU - Vahi, Karan

AU - Rynge, Mats

AU - Mayani, Rajiv

AU - Mayer, Benjamin

N1 - Funding Information: This work was funded by DOE under the contract number #DESC0012636, "Panorama-Predictive Modeling and Diagnostic Monitoring of Extreme Science Workflows"; and by the National Science Foundation under the SI2-SSI program, award number 1148515. Publisher Copyright: © 2016 IEEE.

PY - 2017/3/6

Y1 - 2017/3/6

N2 - Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.

AB - Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.

KW - Environmental Computing

KW - Pegasus Workflow Management System

KW - Scientific workflows

UR - http://www.scopus.com/inward/record.url?scp=85016771384&partnerID=8YFLogxK

U2 - 10.1109/eScience.2016.7870926

DO - 10.1109/eScience.2016.7870926

M3 - Conference contribution

AN - SCOPUS:85016771384

SP - 400

EP - 406

BT - 2016 IEEE 12th International Conference on e-Science (e-Science)

PB - IEEE

T2 - 12th IEEE International Conference on e-Science 2016

Y2 - 23 October 2016 through 27 October 2016

ER -

Automating environmental computing applications with scientific workflows

Abstract

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this