MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Helen Hastie, Francisco Javier Chiyah Garcia, David A. Robb, Pedro Patron, Atanas Laskov

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.
Original languageEnglish
Title of host publicationProceedings of the 19th ACM International Conference on Multimodal Interaction
PublisherACM
Pages495-496
Number of pages2
ISBN (Print)9781450355438
DOIs
Publication statusPublished - 3 Nov 2017

Fingerprint

Simulators

Cite this

Hastie, H., Garcia, F. J. C., Robb, D. A., Patron, P., & Laskov, A. (2017). MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (pp. 495-496). ACM. https://doi.org/10.1145/3136755.3143022
Hastie, Helen ; Garcia, Francisco Javier Chiyah ; Robb, David A. ; Patron, Pedro ; Laskov, Atanas . / MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. Proceedings of the 19th ACM International Conference on Multimodal Interaction. ACM, 2017. pp. 495-496
@inproceedings{3e654f0daed6481e8616ea679f3d2d13,
title = "MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems",
abstract = "We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.",
author = "Helen Hastie and Garcia, {Francisco Javier Chiyah} and Robb, {David A.} and Pedro Patron and Atanas Laskov",
note = "Author Francisco Javier Chiyah Garcia is a student at Heriot-Watt",
year = "2017",
month = "11",
day = "3",
doi = "10.1145/3136755.3143022",
language = "English",
isbn = "9781450355438",
pages = "495--496",
booktitle = "Proceedings of the 19th ACM International Conference on Multimodal Interaction",
publisher = "ACM",

}

Hastie, H, Garcia, FJC, Robb, DA, Patron, P & Laskov, A 2017, MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. in Proceedings of the 19th ACM International Conference on Multimodal Interaction. ACM, pp. 495-496. https://doi.org/10.1145/3136755.3143022

MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. / Hastie, Helen; Garcia, Francisco Javier Chiyah; Robb, David A.; Patron, Pedro; Laskov, Atanas .

Proceedings of the 19th ACM International Conference on Multimodal Interaction. ACM, 2017. p. 495-496.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

AU - Hastie, Helen

AU - Garcia, Francisco Javier Chiyah

AU - Robb, David A.

AU - Patron, Pedro

AU - Laskov, Atanas

N1 - Author Francisco Javier Chiyah Garcia is a student at Heriot-Watt

PY - 2017/11/3

Y1 - 2017/11/3

N2 - We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

AB - We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

U2 - 10.1145/3136755.3143022

DO - 10.1145/3136755.3143022

M3 - Conference contribution

SN - 9781450355438

SP - 495

EP - 496

BT - Proceedings of the 19th ACM International Conference on Multimodal Interaction

PB - ACM

ER -

Hastie H, Garcia FJC, Robb DA, Patron P, Laskov A. MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. In Proceedings of the 19th ACM International Conference on Multimodal Interaction. ACM. 2017. p. 495-496 https://doi.org/10.1145/3136755.3143022