MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Helen Hastie; Francisco Javier Chiyah Garcia; David A. Robb; Pedro Patron; Atanas  Laskov

doi:10.1145/3136755.3143022

MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Helen Hastie
, Francisco Javier Chiyah Garcia
, David A. Robb
, Pedro Patron
, Atanas Laskov

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

15 Citations (Scopus)

101 Downloads (Pure)

Abstract

We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

Original language	English
Title of host publication	Proceedings of the 19th ACM International Conference on Multimodal Interaction
Publisher	Association for Computing Machinery
Pages	495-496
Number of pages	2
ISBN (Print)	9781450355438
DOIs	https://doi.org/10.1145/3136755.3143022
Publication status	Published - 3 Nov 2017

Access to Document

10.1145/3136755.3143022

Download pdfAccepted author manuscript, 1.52 MBLicence: All Rights Reserved

https://dl.acm.org/authorize?N41677Licence: Other

Cite this

@inproceedings{3e654f0daed6481e8616ea679f3d2d13,

title = "MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems",

abstract = "We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.",

author = "Helen Hastie and Garcia, \{Francisco Javier Chiyah\} and Robb, \{David A.\} and Pedro Patron and Atanas Laskov",

note = "Author Francisco Javier Chiyah Garcia is a student at Heriot-Watt",

year = "2017",

month = nov,

day = "3",

doi = "10.1145/3136755.3143022",

language = "English",

isbn = "9781450355438",

pages = "495--496",

booktitle = "Proceedings of the 19th ACM International Conference on Multimodal Interaction",

publisher = "Association for Computing Machinery",

address = "United States",

}

TY - GEN

T1 - MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

AU - Hastie, Helen

AU - Garcia, Francisco Javier Chiyah

AU - Robb, David A.

AU - Patron, Pedro

AU - Laskov, Atanas

N1 - Author Francisco Javier Chiyah Garcia is a student at Heriot-Watt

PY - 2017/11/3

Y1 - 2017/11/3

N2 - We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

AB - We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

U2 - 10.1145/3136755.3143022

DO - 10.1145/3136755.3143022

M3 - Conference contribution

SN - 9781450355438

SP - 495

EP - 496

BT - Proceedings of the 19th ACM International Conference on Multimodal Interaction

PB - Association for Computing Machinery

ER -

MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Abstract

Access to Document

Fingerprint

Cite this