Exploring Interaction with Remote Autonomous Systems using Conversational Agents

David A. Robb; Jose Lopes; Stefano Padilla; Atanas  Laskov; Francisco Javier Chiyah Garcia; Xingkun Liu; Jonatan Scharff Willners; Nicolas Valeyrie; Katrin Lohan; David Lane; Pedro Patron; Yvan Petillot; Michael John Chantler; Helen Hastie

doi:10.1145/3322276.3322318

Exploring Interaction with Remote Autonomous Systems using Conversational Agents

David A. Robb, Jose Lopes, Stefano Padilla, Atanas Laskov, Francisco Javier Chiyah Garcia, Xingkun Liu, Jonatan Scharff Willners, Nicolas Valeyrie, Katrin Lohan, David Lane, Pedro Patron, Yvan Petillot, Michael John Chantler, Helen Hastie

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

184 Downloads (Pure)

Abstract

Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems,
we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.

Original language	English
Title of host publication	DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference
Publisher	Association for Computing Machinery
Pages	1543-1556
Number of pages	14
ISBN (Electronic)	9781450358507
DOIs	https://doi.org/10.1145/3322276.3322318
Publication status	Published - 18 Jun 2019
Event	2019 ACM conference on Designing Interactive Systems: Contesting Borders and Intersections - Hyatt Regency Mission Bay, San Diego, United States Duration: 23 Jun 2019 → 28 Jun 2019 https://dis2019.com/

Conference

Conference	2019 ACM conference on Designing Interactive Systems
Abbreviated title	DIS'19
Country/Territory	United States
City	San Diego
Period	23/06/19 → 28/06/19
Internet address	https://dis2019.com/

Keywords

Explainable AI
Multimodal interfaces
Natural language interfaces
Remote autonomous systems
Transparency
Trust

ASJC Scopus subject areas

Computer Networks and Communications
Human-Computer Interaction

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1145/3322276.3322318

Download pdf
© Author 2019. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in DIS ’19: Designing Interactive Systems Conference, http://dx.doi.org/10.1145/3322276.3322318
Accepted author manuscript, 1.14 MB

Cite this

Robb, D. A., Lopes, J., Padilla, S., Laskov, A., Garcia, F. J. C., Liu, X., Scharff Willners, J., Valeyrie, N., Lohan, K., Lane, D., Patron, P., Petillot, Y., Chantler, M. J., & Hastie, H. (2019). Exploring Interaction with Remote Autonomous Systems using Conversational Agents. In DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference (pp. 1543-1556). Association for Computing Machinery. https://doi.org/10.1145/3322276.3322318

@inproceedings{eaa73bdac3274b2fba2423c4b28bb4e8,

title = "Exploring Interaction with Remote Autonomous Systems using Conversational Agents",

abstract = "Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.",

keywords = "Explainable AI, Multimodal interfaces, Natural language interfaces, Remote autonomous systems, Transparency, Trust",

author = "Robb, {David A.} and Jose Lopes and Stefano Padilla and Atanas Laskov and Garcia, {Francisco Javier Chiyah} and Xingkun Liu and {Scharff Willners}, Jonatan and Nicolas Valeyrie and Katrin Lohan and David Lane and Pedro Patron and Yvan Petillot and Chantler, {Michael John} and Helen Hastie",

year = "2019",

month = jun,

day = "18",

doi = "10.1145/3322276.3322318",

language = "English",

pages = "1543--1556",

booktitle = "DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference",

publisher = "Association for Computing Machinery",

address = "United States",

note = "2019 ACM conference on Designing Interactive Systems : Contesting Borders and Intersections, DIS'19 ; Conference date: 23-06-2019 Through 28-06-2019",

url = "https://dis2019.com/",

}

Robb, DA, Lopes, J, Padilla, S, Laskov, A, Garcia, FJC, Liu, X, Scharff Willners, J, Valeyrie, N, Lohan, K, Lane, D, Patron, P, Petillot, Y , Chantler, MJ & Hastie, H 2019, Exploring Interaction with Remote Autonomous Systems using Conversational Agents. in DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference. Association for Computing Machinery, pp. 1543-1556, 2019 ACM conference on Designing Interactive Systems, San Diego, California, United States, 23/06/19. https://doi.org/10.1145/3322276.3322318

TY - GEN

T1 - Exploring Interaction with Remote Autonomous Systems using Conversational Agents

AU - Robb, David A.

AU - Lopes, Jose

AU - Padilla, Stefano

AU - Laskov, Atanas

AU - Garcia, Francisco Javier Chiyah

AU - Liu, Xingkun

AU - Scharff Willners, Jonatan

AU - Valeyrie, Nicolas

AU - Lohan, Katrin

AU - Lane, David

AU - Patron, Pedro

AU - Petillot, Yvan

AU - Chantler, Michael John

AU - Hastie, Helen

PY - 2019/6/18

Y1 - 2019/6/18

N2 - Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.

AB - Autonomous vehicles and robots are increasingly being deployed to remote, dangerous environments in the energy sector, search and rescue and the military. As a result, there is a need for humans to interact with these robots to monitor their tasks, such as inspecting and repairing offshore wind-turbines. Conversational Agents can improve situation awareness and transparency, while being a hands-free medium to communicate key information quickly and succinctly. As part of our user-centered design of such systems, we conducted an in-depth immersive qualitative study of twelve marine research scientists and engineers, interacting with a prototype Conversational Agent. Our results expose insights into the appropriate content and style for the natural language interaction and, from this study, we derive nine design recommendations to inform future Conversational Agent design for remote autonomous systems.

KW - Explainable AI

KW - Multimodal interfaces

KW - Natural language interfaces

KW - Remote autonomous systems

KW - Transparency

KW - Trust

UR - http://www.scopus.com/inward/record.url?scp=85070652327&partnerID=8YFLogxK

U2 - 10.1145/3322276.3322318

DO - 10.1145/3322276.3322318

M3 - Conference contribution

SP - 1543

EP - 1556

BT - DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference

PB - Association for Computing Machinery

T2 - 2019 ACM conference on Designing Interactive Systems

Y2 - 23 June 2019 through 28 June 2019

ER -

Exploring Interaction with Remote Autonomous Systems using Conversational Agents

Abstract

Conference

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this