MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Helen Hastie, Francisco Javier Chiyah Garcia, David A. Robb, Pedro Patron, Atanas Laskov

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)
62 Downloads (Pure)


We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.
Original languageEnglish
Title of host publicationProceedings of the 19th ACM International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery
Number of pages2
ISBN (Print)9781450355438
Publication statusPublished - 3 Nov 2017


Dive into the research topics of 'MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems'. Together they form a unique fingerprint.

Cite this