Intelligent workflow management for Fish4Knowledge using the SWELL system

Gayathri Nadarajan, Cheng-Lin Yang, Yun-Heh Chen-Burger

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

F4K’s workflow component is the chief mediator between the user interface (UI) and the video and image processing (VIP) components that reside in F4K’s high performance computing (HPC) platforms. Not only does it decompose high level user queries into lower video-level command-line invocations, it also makes its own decisions on which VIP modules and the best parameters to select, which hardware platform to perform the video processing executions on and which fault tolerance strategies to take during the executions so as to optimize the overall system’s performance. In this chapter, we describe the workings of F4K’s workflow component, SWELL (Semantic Workflows with Error Handling for Large Video Analyses) which comprises a workflow engine and a workflow monitor. We also describe the F4K domain ontologies that have heavily influenced the development of SWELL and have been used for term matching between partner components.
LanguageEnglish
Title of host publicationFish4Knowledge
Subtitle of host publicationCollecting and Analyzing Massive Coral Reef Fish Video Data
EditorsRobert B. Fisher, Yun-Heh Chen-Burger, Daniela Giordano, Lynda Hardman, Fang-Pang Lin
PublisherSpringer International Publishing
Pages83-101
Number of pages19
ISBN (Electronic)9783319302089
ISBN (Print)9783319302065
DOIs
Publication statusPublished - 2016

Publication series

NameIntelligent Systems Reference Library
PublisherSpringer International Publishing
Volume104
ISSN (Print)1868-4394

Fingerprint

Image processing
Fault tolerance
User interfaces
Ontology
Semantics
Engines
Hardware
Processing

Cite this

Nadarajan, G., Yang, C-L., & Chen-Burger, Y-H. (2016). Intelligent workflow management for Fish4Knowledge using the SWELL system. In R. B. Fisher, Y-H. Chen-Burger, D. Giordano, L. Hardman, & F-P. Lin (Eds.), Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data (pp. 83-101). (Intelligent Systems Reference Library; Vol. 104). Springer International Publishing. https://doi.org/10.1007/978-3-319-30208-9_8
Nadarajan, Gayathri ; Yang, Cheng-Lin ; Chen-Burger, Yun-Heh. / Intelligent workflow management for Fish4Knowledge using the SWELL system. Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data. editor / Robert B. Fisher ; Yun-Heh Chen-Burger ; Daniela Giordano ; Lynda Hardman ; Fang-Pang Lin. Springer International Publishing, 2016. pp. 83-101 (Intelligent Systems Reference Library).
@inbook{d411d5521a7147fcbbdc0ace31b5cb31,
title = "Intelligent workflow management for Fish4Knowledge using the SWELL system",
abstract = "F4K’s workflow component is the chief mediator between the user interface (UI) and the video and image processing (VIP) components that reside in F4K’s high performance computing (HPC) platforms. Not only does it decompose high level user queries into lower video-level command-line invocations, it also makes its own decisions on which VIP modules and the best parameters to select, which hardware platform to perform the video processing executions on and which fault tolerance strategies to take during the executions so as to optimize the overall system’s performance. In this chapter, we describe the workings of F4K’s workflow component, SWELL (Semantic Workflows with Error Handling for Large Video Analyses) which comprises a workflow engine and a workflow monitor. We also describe the F4K domain ontologies that have heavily influenced the development of SWELL and have been used for term matching between partner components.",
author = "Gayathri Nadarajan and Cheng-Lin Yang and Yun-Heh Chen-Burger",
year = "2016",
doi = "10.1007/978-3-319-30208-9_8",
language = "English",
isbn = "9783319302065",
series = "Intelligent Systems Reference Library",
publisher = "Springer International Publishing",
pages = "83--101",
editor = "Fisher, {Robert B.} and Yun-Heh Chen-Burger and Daniela Giordano and Lynda Hardman and Fang-Pang Lin",
booktitle = "Fish4Knowledge",
address = "Switzerland",

}

Nadarajan, G, Yang, C-L & Chen-Burger, Y-H 2016, Intelligent workflow management for Fish4Knowledge using the SWELL system. in RB Fisher, Y-H Chen-Burger, D Giordano, L Hardman & F-P Lin (eds), Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data. Intelligent Systems Reference Library, vol. 104, Springer International Publishing, pp. 83-101. https://doi.org/10.1007/978-3-319-30208-9_8

Intelligent workflow management for Fish4Knowledge using the SWELL system. / Nadarajan, Gayathri; Yang, Cheng-Lin; Chen-Burger, Yun-Heh.

Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data. ed. / Robert B. Fisher; Yun-Heh Chen-Burger; Daniela Giordano; Lynda Hardman; Fang-Pang Lin. Springer International Publishing, 2016. p. 83-101 (Intelligent Systems Reference Library; Vol. 104).

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Intelligent workflow management for Fish4Knowledge using the SWELL system

AU - Nadarajan, Gayathri

AU - Yang, Cheng-Lin

AU - Chen-Burger, Yun-Heh

PY - 2016

Y1 - 2016

N2 - F4K’s workflow component is the chief mediator between the user interface (UI) and the video and image processing (VIP) components that reside in F4K’s high performance computing (HPC) platforms. Not only does it decompose high level user queries into lower video-level command-line invocations, it also makes its own decisions on which VIP modules and the best parameters to select, which hardware platform to perform the video processing executions on and which fault tolerance strategies to take during the executions so as to optimize the overall system’s performance. In this chapter, we describe the workings of F4K’s workflow component, SWELL (Semantic Workflows with Error Handling for Large Video Analyses) which comprises a workflow engine and a workflow monitor. We also describe the F4K domain ontologies that have heavily influenced the development of SWELL and have been used for term matching between partner components.

AB - F4K’s workflow component is the chief mediator between the user interface (UI) and the video and image processing (VIP) components that reside in F4K’s high performance computing (HPC) platforms. Not only does it decompose high level user queries into lower video-level command-line invocations, it also makes its own decisions on which VIP modules and the best parameters to select, which hardware platform to perform the video processing executions on and which fault tolerance strategies to take during the executions so as to optimize the overall system’s performance. In this chapter, we describe the workings of F4K’s workflow component, SWELL (Semantic Workflows with Error Handling for Large Video Analyses) which comprises a workflow engine and a workflow monitor. We also describe the F4K domain ontologies that have heavily influenced the development of SWELL and have been used for term matching between partner components.

U2 - 10.1007/978-3-319-30208-9_8

DO - 10.1007/978-3-319-30208-9_8

M3 - Chapter

SN - 9783319302065

T3 - Intelligent Systems Reference Library

SP - 83

EP - 101

BT - Fish4Knowledge

A2 - Fisher, Robert B.

A2 - Chen-Burger, Yun-Heh

A2 - Giordano, Daniela

A2 - Hardman, Lynda

A2 - Lin, Fang-Pang

PB - Springer International Publishing

ER -

Nadarajan G, Yang C-L, Chen-Burger Y-H. Intelligent workflow management for Fish4Knowledge using the SWELL system. In Fisher RB, Chen-Burger Y-H, Giordano D, Hardman L, Lin F-P, editors, Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data. Springer International Publishing. 2016. p. 83-101. (Intelligent Systems Reference Library). https://doi.org/10.1007/978-3-319-30208-9_8