Towards visual dialogue for human-robot interaction

Jose L. Part, Daniel Hernández Garciá, Yanchao Yu, Nancie Gunson, Christian Dondrup, Oliver Lemon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The goal of the EU H2020-ICT funded SPRING project is to develop a socially pertinent robot to carry out tasks in a gerontological healthcare unit. In this context, being able to perceive its environment and have coherent and relevant conversations about the surrounding world is critical. In this paper, we describe current progress towards developing the necessary integrated visual and conversational capabilities for a robot to operate in such environments. Concretely, we introduce an architecture for conversing about objects and other entities present in an environment. The work described in this paper has applications that extend well beyond healthcare and can be used on any robot that requires to interact with its visual and spatial environment in order to be able to perform its duties.

Original languageEnglish
Title of host publicationHRI '21 Companion
Subtitle of host publicationCompanion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction
PublisherAssociation for Computing Machinery
Pages670-672
Number of pages3
ISBN (Electronic)9781450382908
DOIs
Publication statusPublished - 8 Mar 2021
Event2021 ACM/IEEE International Conference on Human-Robot Interaction - Virtual Conference, Boulder, United States
Duration: 8 Mar 202111 Mar 2021
https://humanrobotinteraction.org/2021/

Conference

Conference2021 ACM/IEEE International Conference on Human-Robot Interaction
Abbreviated titleHRI '21
CountryUnited States
CityBoulder
Period8/03/2111/03/21
Internet address

Keywords

  • Conversational systems
  • Robotics
  • Visual dialogue

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Towards visual dialogue for human-robot interaction'. Together they form a unique fingerprint.

Cite this