Towards visual dialogue for human-robot interaction

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)


The goal of the EU H2020-ICT funded SPRING project is to develop a socially pertinent robot to carry out tasks in a gerontological healthcare unit. In this context, being able to perceive its environment and have coherent and relevant conversations about the surrounding world is critical. In this paper, we describe current progress towards developing the necessary integrated visual and conversational capabilities for a robot to operate in such environments. Concretely, we introduce an architecture for conversing about objects and other entities present in an environment. The work described in this paper has applications that extend well beyond healthcare and can be used on any robot that requires to interact with its visual and spatial environment in order to be able to perform its duties.

Original languageEnglish
Title of host publicationHRI '21 Companion
Subtitle of host publicationCompanion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction
PublisherAssociation for Computing Machinery
Number of pages3
ISBN (Electronic)9781450382908
Publication statusPublished - 8 Mar 2021
Event2021 ACM/IEEE International Conference on Human-Robot Interaction - Virtual Conference, Boulder, United States
Duration: 8 Mar 202111 Mar 2021


Conference2021 ACM/IEEE International Conference on Human-Robot Interaction
Abbreviated titleHRI '21
Country/TerritoryUnited States
Internet address


  • Conversational systems
  • Robotics
  • Visual dialogue

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Electrical and Electronic Engineering


Dive into the research topics of 'Towards visual dialogue for human-robot interaction'. Together they form a unique fingerprint.

Cite this