Real-time simulation of virtual humans' emotional facial expressions, harnessing autonomic physiological and musculoskeletal control

Yvaine Tisserand, Ruth Aylett, Marcello Mortillaro, David Rudrauf

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Emotion expressions and communication involve involuntary and voluntary processes that may not always operate consistently. Expressive behaviour involving physiological changes may carry information about hidden aspects of emotional experience important for accurate emotion recognition and social cognition. In this paper, we describe a principled approach to simulating Virtual Human physiological facial features related to the autonomic nervous system (ANS). Our approach is based on typical synergies within the two branches of the ANS. It covers both parasympathetic tone and sympathetic tone, and their impact on skin tone, pupil diameter and sweat. We also present the triggering of tears. We discuss the implementation of the approach as part of a 3D toolkit. This work is aimed at supporting the development of affective features for realtime intelligent artificial agents, and the study of the perception of mixed emotion and emotion regulation. We demonstrate how varying ANS parameters impacts facial behaviour, contrasting emotionally consistent vs inconsistent musculoskeletal and ANS-related features.
Original languageEnglish
Title of host publicationIVA '20: Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents
PublisherAssociation for Computing Machinery
ISBN (Print)9781450375863
DOIs
Publication statusPublished - 20 Oct 2020
Event20th ACM International Conference on Intelligent Virtual Agents 2020 - Glasgow, United Kingdom
Duration: 20 Oct 202022 Oct 2020

Conference

Conference20th ACM International Conference on Intelligent Virtual Agents 2020
Abbreviated titleIVA '20
Country/TerritoryUnited Kingdom
CityGlasgow
Period20/10/2022/10/20

Keywords

  • Virtual Human
  • autonomic nervous system
  • emotions
  • facial communication
  • facial expression
  • musculoskeletal control
  • physiological control

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Real-time simulation of virtual humans' emotional facial expressions, harnessing autonomic physiological and musculoskeletal control'. Together they form a unique fingerprint.

Cite this