Exploring Interaction with Remote Autonomous Systems using Conversational Agents

David A. Robb, Jose Lopes, Stefano Padilla, Atanas Laskov, Francisco Javier Chiyah Garcia, Xingkun Liu, Jonatan Scharff Willners, Nicolas Valeyrie, Katrin Lohan, David Lane, Pedro Patron, Yvan Petillot, Michael John Chantler, Helen Hastie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems,
we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.
Original languageEnglish
Title of host publicationDIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference
PublisherACM
Pages1543-1556
Number of pages14
ISBN (Electronic)9781450358507
DOIs
Publication statusPublished - 18 Jun 2019
Event2019 ACM conference on Designing Interactive Systems: Contesting Borders and Intersections - Hyatt Regency Mission Bay, San Diego, United States
Duration: 23 Jun 201928 Jun 2019
https://dis2019.com/

Conference

Conference2019 ACM conference on Designing Interactive Systems
Abbreviated titleDIS'19
CountryUnited States
CitySan Diego
Period23/06/1928/06/19
Internet address

Fingerprint

Robots
Offshore wind turbines
Transparency
Engineers
User centered design

Keywords

  • Explainable AI
  • Multimodal interfaces
  • Natural language interfaces
  • Remote autonomous systems
  • Transparency
  • Trust

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Human-Computer Interaction

Cite this

Robb, D. A., Lopes, J., Padilla, S., Laskov, A., Garcia, F. J. C., Liu, X., ... Hastie, H. (2019). Exploring Interaction with Remote Autonomous Systems using Conversational Agents. In DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference (pp. 1543-1556). ACM. https://doi.org/10.1145/3322276.3322318
Robb, David A. ; Lopes, Jose ; Padilla, Stefano ; Laskov, Atanas ; Garcia, Francisco Javier Chiyah ; Liu, Xingkun ; Scharff Willners, Jonatan ; Valeyrie, Nicolas ; Lohan, Katrin ; Lane, David ; Patron, Pedro ; Petillot, Yvan ; Chantler, Michael John ; Hastie, Helen. / Exploring Interaction with Remote Autonomous Systems using Conversational Agents. DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference. ACM, 2019. pp. 1543-1556
@inproceedings{eaa73bdac3274b2fba2423c4b28bb4e8,
title = "Exploring Interaction with Remote Autonomous Systems using Conversational Agents",
abstract = "Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.",
keywords = "Explainable AI, Multimodal interfaces, Natural language interfaces, Remote autonomous systems, Transparency, Trust",
author = "Robb, {David A.} and Jose Lopes and Stefano Padilla and Atanas Laskov and Garcia, {Francisco Javier Chiyah} and Xingkun Liu and {Scharff Willners}, Jonatan and Nicolas Valeyrie and Katrin Lohan and David Lane and Pedro Patron and Yvan Petillot and Chantler, {Michael John} and Helen Hastie",
year = "2019",
month = "6",
day = "18",
doi = "10.1145/3322276.3322318",
language = "English",
pages = "1543--1556",
booktitle = "DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference",
publisher = "ACM",

}

Robb, DA, Lopes, J, Padilla, S, Laskov, A, Garcia, FJC, Liu, X, Scharff Willners, J, Valeyrie, N, Lohan, K, Lane, D, Patron, P, Petillot, Y, Chantler, MJ & Hastie, H 2019, Exploring Interaction with Remote Autonomous Systems using Conversational Agents. in DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference. ACM, pp. 1543-1556, 2019 ACM conference on Designing Interactive Systems, San Diego, United States, 23/06/19. https://doi.org/10.1145/3322276.3322318

Exploring Interaction with Remote Autonomous Systems using Conversational Agents. / Robb, David A.; Lopes, Jose; Padilla, Stefano; Laskov, Atanas ; Garcia, Francisco Javier Chiyah; Liu, Xingkun; Scharff Willners, Jonatan; Valeyrie, Nicolas; Lohan, Katrin; Lane, David; Patron, Pedro; Petillot, Yvan; Chantler, Michael John; Hastie, Helen.

DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference. ACM, 2019. p. 1543-1556.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Exploring Interaction with Remote Autonomous Systems using Conversational Agents

AU - Robb, David A.

AU - Lopes, Jose

AU - Padilla, Stefano

AU - Laskov, Atanas

AU - Garcia, Francisco Javier Chiyah

AU - Liu, Xingkun

AU - Scharff Willners, Jonatan

AU - Valeyrie, Nicolas

AU - Lohan, Katrin

AU - Lane, David

AU - Patron, Pedro

AU - Petillot, Yvan

AU - Chantler, Michael John

AU - Hastie, Helen

PY - 2019/6/18

Y1 - 2019/6/18

N2 - Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.

AB - Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.

KW - Explainable AI

KW - Multimodal interfaces

KW - Natural language interfaces

KW - Remote autonomous systems

KW - Transparency

KW - Trust

UR - http://www.scopus.com/inward/record.url?scp=85070652327&partnerID=8YFLogxK

U2 - 10.1145/3322276.3322318

DO - 10.1145/3322276.3322318

M3 - Conference contribution

SP - 1543

EP - 1556

BT - DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference

PB - ACM

ER -

Robb DA, Lopes J, Padilla S, Laskov A, Garcia FJC, Liu X et al. Exploring Interaction with Remote Autonomous Systems using Conversational Agents. In DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference. ACM. 2019. p. 1543-1556 https://doi.org/10.1145/3322276.3322318