Cultural Social Signal Interplay with an Expressive Robot

Peter Edward McKenna, Ayan Ghosh, Ruth Aylett, Frank Broz, Gnanathusharan Rajendran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Social robots are being developed as a form of social skills training for individual's with an autism spectrum condition (ASC). Effective training will therefore require the social signals produced by a robot to be contingent with people's knowledge and expectations of social cognition and behaviour. Designing recognisable facial expressions is an important part of this challenge; ensuring interactions are more believable and motivating. This design process requires - amongst other factors - consideration of how culture and native language affects social signal processing. In this experiment participants offered a full-bodied robot (named 'Alyx') food items to which Alyx reacted autonomously, producing either an approving or disapproving expression. Participant's responded to these expressions (i.e. the robots social signals) by indicating whether Alyx liked or disliked the food. Task performance was examined both quantitatively (response time and accuracy) and qualitatively (participant's reactionary expressions). The results revealed significant cultural differences, as non-native English speakers were less accurate at interpreting expressions, but also a similar response trend between these groups. Qualitative analysis supported the notion that Alyx's expressions were not universally understood. These findings are discussed in the context of social skills training.
Original languageEnglish
Title of host publicationProceedings of the 18th International Conference on Intelligent Virtual Agents
PublisherACM
Pages211-218
Number of pages8
ISBN (Print)9781450360135
DOIs
Publication statusPublished - 5 Nov 2018
Event18th ACM International Conference on Intelligent Virtual Agents 2018 - Sydney, Australia
Duration: 5 Nov 20188 Nov 2018
https://iva2018.westernsydney.edu.au/

Conference

Conference18th ACM International Conference on Intelligent Virtual Agents 2018
Abbreviated titleIVR 2018
CountryAustralia
CitySydney
Period5/11/188/11/18
Internet address

Fingerprint

Robots
Signal processing
Experiments

Cite this

McKenna, P. E., Ghosh, A., Aylett, R., Broz, F., & Rajendran, G. (2018). Cultural Social Signal Interplay with an Expressive Robot. In Proceedings of the 18th International Conference on Intelligent Virtual Agents (pp. 211-218 ). ACM. https://doi.org/10.1145/3267851.3267905
McKenna, Peter Edward ; Ghosh, Ayan ; Aylett, Ruth ; Broz, Frank ; Rajendran, Gnanathusharan. / Cultural Social Signal Interplay with an Expressive Robot. Proceedings of the 18th International Conference on Intelligent Virtual Agents. ACM, 2018. pp. 211-218
@inproceedings{4a7d006a43d24148b7d8edb67c9ebefa,
title = "Cultural Social Signal Interplay with an Expressive Robot",
abstract = "Social robots are being developed as a form of social skills training for individual's with an autism spectrum condition (ASC). Effective training will therefore require the social signals produced by a robot to be contingent with people's knowledge and expectations of social cognition and behaviour. Designing recognisable facial expressions is an important part of this challenge; ensuring interactions are more believable and motivating. This design process requires - amongst other factors - consideration of how culture and native language affects social signal processing. In this experiment participants offered a full-bodied robot (named 'Alyx') food items to which Alyx reacted autonomously, producing either an approving or disapproving expression. Participant's responded to these expressions (i.e. the robots social signals) by indicating whether Alyx liked or disliked the food. Task performance was examined both quantitatively (response time and accuracy) and qualitatively (participant's reactionary expressions). The results revealed significant cultural differences, as non-native English speakers were less accurate at interpreting expressions, but also a similar response trend between these groups. Qualitative analysis supported the notion that Alyx's expressions were not universally understood. These findings are discussed in the context of social skills training.",
author = "McKenna, {Peter Edward} and Ayan Ghosh and Ruth Aylett and Frank Broz and Gnanathusharan Rajendran",
year = "2018",
month = "11",
day = "5",
doi = "10.1145/3267851.3267905",
language = "English",
isbn = "9781450360135",
pages = "211--218",
booktitle = "Proceedings of the 18th International Conference on Intelligent Virtual Agents",
publisher = "ACM",

}

McKenna, PE, Ghosh, A, Aylett, R, Broz, F & Rajendran, G 2018, Cultural Social Signal Interplay with an Expressive Robot. in Proceedings of the 18th International Conference on Intelligent Virtual Agents. ACM, pp. 211-218 , 18th ACM International Conference on Intelligent Virtual Agents 2018, Sydney, Australia, 5/11/18. https://doi.org/10.1145/3267851.3267905

Cultural Social Signal Interplay with an Expressive Robot. / McKenna, Peter Edward; Ghosh, Ayan; Aylett, Ruth; Broz, Frank; Rajendran, Gnanathusharan.

Proceedings of the 18th International Conference on Intelligent Virtual Agents. ACM, 2018. p. 211-218 .

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Cultural Social Signal Interplay with an Expressive Robot

AU - McKenna, Peter Edward

AU - Ghosh, Ayan

AU - Aylett, Ruth

AU - Broz, Frank

AU - Rajendran, Gnanathusharan

PY - 2018/11/5

Y1 - 2018/11/5

N2 - Social robots are being developed as a form of social skills training for individual's with an autism spectrum condition (ASC). Effective training will therefore require the social signals produced by a robot to be contingent with people's knowledge and expectations of social cognition and behaviour. Designing recognisable facial expressions is an important part of this challenge; ensuring interactions are more believable and motivating. This design process requires - amongst other factors - consideration of how culture and native language affects social signal processing. In this experiment participants offered a full-bodied robot (named 'Alyx') food items to which Alyx reacted autonomously, producing either an approving or disapproving expression. Participant's responded to these expressions (i.e. the robots social signals) by indicating whether Alyx liked or disliked the food. Task performance was examined both quantitatively (response time and accuracy) and qualitatively (participant's reactionary expressions). The results revealed significant cultural differences, as non-native English speakers were less accurate at interpreting expressions, but also a similar response trend between these groups. Qualitative analysis supported the notion that Alyx's expressions were not universally understood. These findings are discussed in the context of social skills training.

AB - Social robots are being developed as a form of social skills training for individual's with an autism spectrum condition (ASC). Effective training will therefore require the social signals produced by a robot to be contingent with people's knowledge and expectations of social cognition and behaviour. Designing recognisable facial expressions is an important part of this challenge; ensuring interactions are more believable and motivating. This design process requires - amongst other factors - consideration of how culture and native language affects social signal processing. In this experiment participants offered a full-bodied robot (named 'Alyx') food items to which Alyx reacted autonomously, producing either an approving or disapproving expression. Participant's responded to these expressions (i.e. the robots social signals) by indicating whether Alyx liked or disliked the food. Task performance was examined both quantitatively (response time and accuracy) and qualitatively (participant's reactionary expressions). The results revealed significant cultural differences, as non-native English speakers were less accurate at interpreting expressions, but also a similar response trend between these groups. Qualitative analysis supported the notion that Alyx's expressions were not universally understood. These findings are discussed in the context of social skills training.

U2 - 10.1145/3267851.3267905

DO - 10.1145/3267851.3267905

M3 - Conference contribution

SN - 9781450360135

SP - 211

EP - 218

BT - Proceedings of the 18th International Conference on Intelligent Virtual Agents

PB - ACM

ER -

McKenna PE, Ghosh A, Aylett R, Broz F, Rajendran G. Cultural Social Signal Interplay with an Expressive Robot. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. ACM. 2018. p. 211-218 https://doi.org/10.1145/3267851.3267905