A Visually-Aware Conversational Robot Receptionist

Nancie Gunson; Daniel Hernandez Garcia; Weronika Sieinska; Angus Addlesee; Christian Dondrup; Oliver Lemon; Jose Part; Yanchao Yu

doi:10.18653/v1/2022.sigdial-1.61

A Visually-Aware Conversational Robot Receptionist

Nancie Gunson, Daniel Hernandez Garcia, Weronika Sieinska, Angus Addlesee, Christian Dondrup, Oliver Lemon, Jose Part, Yanchao Yu

Research output: Chapter in Book/Report/Conference proceeding › Chapter (peer-reviewed) › peer-review

5 Citations (Scopus)

Abstract

Socially Assistive Robots (SARs) have the potential to play an increasingly important role in a variety of contexts including healthcare, but most existing systems have very limited interactive capabilities. We will demonstrate a robot receptionist that not only supports task-based and social dialogue via natural spoken conversation but is also capable of visually grounded dialogue; able to perceive and discuss the shared physical environment (e.g. helping users to locate personal belongings or objects of interest). Task-based dialogues include check-in, navigation and FAQs about facilities, alongside social features such as chit-chat, access to the latest news and a quiz game to play while waiting.
We also show how visual context (objects and their spatial relations) can be combined with linguistic representations of dialogue context, to support visual dialogue and question answering.
We will demonstrate the system on a humanoid ARI robot, which is being deployed in a hospital reception area.

Original language	English
Title of host publication	Proceedings of SIGdial'22: 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue
Publisher	Association for Computational Linguistics
Pages	645-648
Number of pages	4
ISBN (Print)	978-1-955917-66-7
DOIs	https://doi.org/10.18653/v1/2022.sigdial-1.61
Publication status	Published - 7 Sept 2022

Keywords

Visual Dialogue
HRI
Robot Receptionist
Dialogue systems

Access to Document

10.18653/v1/2022.sigdial-1.61Licence: CC BY

https://aclanthology.org/2022.sigdial-1.61/

Cite this

Gunson, N., Hernandez Garcia, D., Sieinska, W., Addlesee, A., Dondrup, C., Lemon, O., Part, J., & Yu, Y. (2022). A Visually-Aware Conversational Robot Receptionist. In Proceedings of SIGdial'22: 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue (pp. 645-648). Association for Computational Linguistics. https://doi.org/10.18653/v1/2022.sigdial-1.61

@inbook{883a8358a14b400fa934187a9f15acf6,

title = "A Visually-Aware Conversational Robot Receptionist",

abstract = "Socially Assistive Robots (SARs) have the potential to play an increasingly important role in a variety of contexts including healthcare, but most existing systems have very limited interactive capabilities. We will demonstrate a robot receptionist that not only supports task-based and social dialogue via natural spoken conversation but is also capable of visually grounded dialogue; able to perceive and discuss the shared physical environment (e.g. helping users to locate personal belongings or objects of interest). Task-based dialogues include check-in, navigation and FAQs about facilities, alongside social features such as chit-chat, access to the latest news and a quiz game to play while waiting. We also show how visual context (objects and their spatial relations) can be combined with linguistic representations of dialogue context, to support visual dialogue and question answering.We will demonstrate the system on a humanoid ARI robot, which is being deployed in a hospital reception area.",

keywords = "Visual Dialogue, HRI, Robot Receptionist, Dialogue systems",

author = "Nancie Gunson and {Hernandez Garcia}, Daniel and Weronika Sieinska and Angus Addlesee and Christian Dondrup and Oliver Lemon and Jose Part and Yanchao Yu",

year = "2022",

month = sep,

day = "7",

doi = "10.18653/v1/2022.sigdial-1.61",

language = "English",

isbn = " 978-1-955917-66-7",

pages = "645--648",

booktitle = "Proceedings of SIGdial'22: 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue",

publisher = "Association for Computational Linguistics",

}

A Visually-Aware Conversational Robot Receptionist. / Gunson, Nancie ; Hernandez Garcia, Daniel; Sieinska, Weronika et al.
Proceedings of SIGdial'22: 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue. Association for Computational Linguistics, 2022. p. 645-648.

Research output: Chapter in Book/Report/Conference proceeding › Chapter (peer-reviewed) › peer-review

TY - CHAP

T1 - A Visually-Aware Conversational Robot Receptionist

AU - Gunson, Nancie

AU - Hernandez Garcia, Daniel

AU - Sieinska, Weronika

AU - Addlesee, Angus

AU - Dondrup, Christian

AU - Lemon, Oliver

AU - Part, Jose

AU - Yu, Yanchao

PY - 2022/9/7

Y1 - 2022/9/7

N2 - Socially Assistive Robots (SARs) have the potential to play an increasingly important role in a variety of contexts including healthcare, but most existing systems have very limited interactive capabilities. We will demonstrate a robot receptionist that not only supports task-based and social dialogue via natural spoken conversation but is also capable of visually grounded dialogue; able to perceive and discuss the shared physical environment (e.g. helping users to locate personal belongings or objects of interest). Task-based dialogues include check-in, navigation and FAQs about facilities, alongside social features such as chit-chat, access to the latest news and a quiz game to play while waiting. We also show how visual context (objects and their spatial relations) can be combined with linguistic representations of dialogue context, to support visual dialogue and question answering.We will demonstrate the system on a humanoid ARI robot, which is being deployed in a hospital reception area.

AB - Socially Assistive Robots (SARs) have the potential to play an increasingly important role in a variety of contexts including healthcare, but most existing systems have very limited interactive capabilities. We will demonstrate a robot receptionist that not only supports task-based and social dialogue via natural spoken conversation but is also capable of visually grounded dialogue; able to perceive and discuss the shared physical environment (e.g. helping users to locate personal belongings or objects of interest). Task-based dialogues include check-in, navigation and FAQs about facilities, alongside social features such as chit-chat, access to the latest news and a quiz game to play while waiting. We also show how visual context (objects and their spatial relations) can be combined with linguistic representations of dialogue context, to support visual dialogue and question answering.We will demonstrate the system on a humanoid ARI robot, which is being deployed in a hospital reception area.

KW - Visual Dialogue

KW - HRI

KW - Robot Receptionist

KW - Dialogue systems

U2 - 10.18653/v1/2022.sigdial-1.61

DO - 10.18653/v1/2022.sigdial-1.61

M3 - Chapter (peer-reviewed)

SN - 978-1-955917-66-7

SP - 645

EP - 648

BT - Proceedings of SIGdial'22: 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue

PB - Association for Computational Linguistics

ER -

A Visually-Aware Conversational Robot Receptionist

Abstract

Keywords

Access to Document

Fingerprint

Cite this