Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot

Matthew P. Aylett; Andrea Carmantini; Christoper J. Pidcock; Eric Nichols; Randy Gomez; Sarah Rose Siskind

doi:10.1145/3568294

Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot

Matthew P. Aylett, Andrea Carmantini, Christoper J. Pidcock, Eric Nichols, Randy Gomez, Sarah Rose Siskind

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Current robot dialog systems are predominantly implemented using a sequential, utterance based, two-party, speak-wait/speak-wait approach. This is inadequate for any interaction where rapid timed turn-taking is required. In this demo we show how a conversational listener can support a comedy dialogue with the social robot 'Haru'. The system depends on fast local word-spotting and can be extended to support scripted and semi-scripted interactions where conversational timing is important such as fictive dialogues for educational purposes, or to support acting within a story telling context. The system could also be integrated with a full dialogue manager for non-scripted open dialogue applications.

Original language	English
Title of host publication	HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction
Publisher	Association for Computing Machinery
Pages	912-913
Number of pages	2
ISBN (Print)	9781450399708
DOIs	https://doi.org/10.1145/3568294
Publication status	Published - 13 Mar 2023

Access to Document

10.1145/3568294

Cite this

Aylett, M. P., Carmantini, A., Pidcock, C. J., Nichols, E., Gomez, R., & Siskind, S. R. (2023). Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot. In HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (pp. 912-913). Association for Computing Machinery. https://doi.org/10.1145/3568294

@inproceedings{ada0664b424245f3ae72b2f25cc32b96,

title = "Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot",

abstract = "Current robot dialog systems are predominantly implemented using a sequential, utterance based, two-party, speak-wait/speak-wait approach. This is inadequate for any interaction where rapid timed turn-taking is required. In this demo we show how a conversational listener can support a comedy dialogue with the social robot 'Haru'. The system depends on fast local word-spotting and can be extended to support scripted and semi-scripted interactions where conversational timing is important such as fictive dialogues for educational purposes, or to support acting within a story telling context. The system could also be integrated with a full dialogue manager for non-scripted open dialogue applications.",

author = "Aylett, {Matthew P.} and Andrea Carmantini and Pidcock, {Christoper J.} and Eric Nichols and Randy Gomez and Siskind, {Sarah Rose}",

year = "2023",

month = mar,

day = "13",

doi = "10.1145/3568294",

language = "English",

isbn = "9781450399708",

pages = "912--913",

booktitle = "HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction",

publisher = "Association for Computing Machinery",

address = "United States",

}

Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot. / Aylett, Matthew P.; Carmantini, Andrea; Pidcock, Christoper J. et al.
HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. Association for Computing Machinery, 2023. p. 912-913.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot

AU - Aylett, Matthew P.

AU - Carmantini, Andrea

AU - Pidcock, Christoper J.

AU - Nichols, Eric

AU - Gomez, Randy

AU - Siskind, Sarah Rose

PY - 2023/3/13

Y1 - 2023/3/13

N2 - Current robot dialog systems are predominantly implemented using a sequential, utterance based, two-party, speak-wait/speak-wait approach. This is inadequate for any interaction where rapid timed turn-taking is required. In this demo we show how a conversational listener can support a comedy dialogue with the social robot 'Haru'. The system depends on fast local word-spotting and can be extended to support scripted and semi-scripted interactions where conversational timing is important such as fictive dialogues for educational purposes, or to support acting within a story telling context. The system could also be integrated with a full dialogue manager for non-scripted open dialogue applications.

AB - Current robot dialog systems are predominantly implemented using a sequential, utterance based, two-party, speak-wait/speak-wait approach. This is inadequate for any interaction where rapid timed turn-taking is required. In this demo we show how a conversational listener can support a comedy dialogue with the social robot 'Haru'. The system depends on fast local word-spotting and can be extended to support scripted and semi-scripted interactions where conversational timing is important such as fictive dialogues for educational purposes, or to support acting within a story telling context. The system could also be integrated with a full dialogue manager for non-scripted open dialogue applications.

U2 - 10.1145/3568294

DO - 10.1145/3568294

M3 - Conference contribution

SN - 9781450399708

SP - 912

EP - 913

BT - HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

PB - Association for Computing Machinery

ER -

Haru He's Here to Help! A Demonstration of Implementing Comedic Rapid Turn-taking for a Social Robot

Abstract

Access to Document

Fingerprint

Cite this