A Community Roadmap for Scientific Workflows Research and Development

Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Ilkay Altintas, Rosa M. Badia, Bartosz Balis, Taina Coleman, Frederik Coppens, Frank Di Natale, Bjoern Enders, Thomas Fahringer, Rosa Filgueira, Grigori Fursin, Daniel Garijo, Carole Goble, Dorran Howell, Shantenu Jha, Daniel S. Katz, Daniel Laney, Ulf LeserMacIej Malawski, Kshitij Mehta, Loic Pottier, Jonathan Ozik, J. Luc Peterson, Lavanya Ramakrishnan, Stian Soiland-Reyes, Douglas Thain, Matthew Wolf

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual 'Workflows Community Summits' (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.

Original languageEnglish
Title of host publication2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS)
PublisherIEEE
Pages81-90
Number of pages10
ISBN (Electronic)9781665411363
DOIs
Publication statusPublished - 28 Dec 2021
Event16th IEEE Workshop on Workflows in Support of Large-Scale Science 2021 - St. Louis, United States
Duration: 15 Nov 2021 → …

Conference

Conference16th IEEE Workshop on Workflows in Support of Large-Scale Science 2021
Abbreviated titleWORKS 2021
Country/TerritoryUnited States
CitySt. Louis
Period15/11/21 → …

Keywords

  • AI workflows
  • Community roadmap
  • Data management
  • Exascale computing
  • Interoperability
  • Scientific workflows

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Information Systems and Management
  • Chemical Engineering (miscellaneous)
  • Engineering (miscellaneous)
  • Health Informatics
  • Education

Fingerprint

Dive into the research topics of 'A Community Roadmap for Scientific Workflows Research and Development'. Together they form a unique fingerprint.

Cite this