We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.
Hastie, H., Garcia, F. J. C., Robb, D. A., Patron, P., & Laskov, A. (2017). MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (pp. 495-496). ACM. https://doi.org/10.1145/3136755.3143022