Working with roubles and failures in conversation between humans and robots: workshop report

Frank Förster, Marta Romeo, Patrick Holthaus, Luke J. Wood, Christian Dondrup, Joel E. Fischer, Farhana Ferdousi Liza, Sara Kaszuba, Julian Hough, Birthe Nesset, Daniel Hernández García, Dimosthenis Kontogiorgos, Jennifer Williams, Elif Ecem Özkan, Pepita Barnard, Gustavo Berumen, Dominic Price, Sue Cobb, Martina Wiltschko, Lucien TisserandMartin Porcheron, Manuel Giuliani, Gabriel Skantze, Patrick G. T. Healey, Ioannis Papaioannou, Dimitra Gkatzia, Saul Albert, Guanyu Huang, Vladislav Maraev, Epaminondas Kapetanios

Research output: Contribution to journalArticlepeer-review


This paper summarizes the structure and findings from the first . The workshop was organized to bring together a small, interdisciplinary group of researchers working on miscommunication from two complementary perspectives. One group of technology-oriented researchers was made up of roboticists, Human-Robot Interaction (HRI) researchers and dialogue system experts. The second group involved experts from conversation analysis, cognitive science, and linguistics. Uniting both groups of researchers is the belief that communication failures between humans and machines need to be taken seriously and that a systematic analysis of such failures may open fruitful avenues in research beyond current practices to improve such systems, including both speech-centric and multimodal interfaces. This workshop represents a starting point for this endeavour. The aim of the workshop was threefold: Firstly, to establish an interdisciplinary network of researchers that share a common interest in investigating communicative failures with a particular view towards robotic speech interfaces; secondly, to gain a partial overview of the "failure landscape" as experienced by roboticists and HRI researchers; and thirdly, to determine the potential for creating a robotic benchmark scenario for testing future speech interfaces with respect to the identified failures. The present article summarizes both the "failure landscape" surveyed during the workshop as well as the outcomes of the attempt to define a benchmark scenario. [Abstract copyright: Copyright © 2023 Förster, Romeo, Holthaus, Wood, Dondrup, Fischer, Liza, Kaszuba, Hough, Nesset, Hernández García, Kontogiorgos, Williams, Özkan, Barnard, Berumen, Price, Cobb, Wiltschko, Tisserand, Porcheron, Giuliani, Skantze, Healey, Papaioannou, Gkatzia, Albert, Huang, Maraev and Kapetanios.]
Original languageEnglish
Article number1202306
JournalFrontiers in Robotics and AI
Publication statusPublished - 1 Dec 2023


  • multi-modal interaction
  • communicative failure
  • dialogue systems
  • speech interfaces
  • repair
  • human-robot interaction


Dive into the research topics of 'Working with roubles and failures in conversation between humans and robots: workshop report'. Together they form a unique fingerprint.

Cite this