An architecture for emotional facial expressions as social signals

Ruth Aylett; Christopher Ritter; Mei Yii Lim; Frank Broz; Peter McKenna; Ingo Keller; Gnanathusharan Rajendran

doi:10.1109/TAFFC.2019.2906200

An architecture for emotional facial expressions as social signals

Ruth Aylett, Christopher Ritter, Mei Yii Lim, Frank Broz, Peter McKenna, Ingo Keller, Gnanathusharan Rajendran

University of Bielefeld

Research output: Contribution to journal › Article › peer-review

225 Downloads (Pure)

Abstract

We focus on affective architecture issues relating to the generation of expressive facial behaviour, critique approaches that treat expressive behaviour as only a mirror of internal state rather than as also a social signal and discuss the advantages of combining the two approaches. Using the FAtiMA architecture, we analyse the requirements for generating expressive behavior as social signals at both reactive and cognitive levels. We discuss how facial expressions can be generated in a dynamic fashion. We propose generic architectural mechanisms to meet these requirements based on an explicit mind-body loop and Theory of Mind (ToM) processing. A illustrative scenario is given.

Original language	English
Pages (from-to)	293-305
Number of pages	13
Journal	IEEE Transactions on Affecticve Computing
Volume	12
Issue number	2
Early online date	19 Mar 2019
DOIs	https://doi.org/10.1109/TAFFC.2019.2906200
Publication status	Published - Apr 2021

Keywords

Intelligent agents
affective computing
cognitive informatics
interactive systems
software architecture

ASJC Scopus subject areas

Software
Human-Computer Interaction

Access to Document

10.1109/TAFFC.2019.2906200

Download pdf
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Accepted author manuscript, 2.28 MB

Cite this

@article{59eac2905cc249f38fa60410744eb5f4,

title = "An architecture for emotional facial expressions as social signals",

abstract = "We focus on affective architecture issues relating to the generation of expressive facial behaviour, critique approaches that treat expressive behaviour as only a mirror of internal state rather than as also a social signal and discuss the advantages of combining the two approaches. Using the FAtiMA architecture, we analyse the requirements for generating expressive behavior as social signals at both reactive and cognitive levels. We discuss how facial expressions can be generated in a dynamic fashion. We propose generic architectural mechanisms to meet these requirements based on an explicit mind-body loop and Theory of Mind (ToM) processing. A illustrative scenario is given.",

keywords = "Intelligent agents, affective computing, cognitive informatics, interactive systems, software architecture",

author = "Ruth Aylett and Christopher Ritter and Lim, {Mei Yii} and Frank Broz and Peter McKenna and Ingo Keller and Gnanathusharan Rajendran",

note = "Funding Information: The authors would like to thank members of the project ECUTE (ICT-5-4.2257666), whose work was partially supported by the European Commission (EC). The authors are solely responsible for the content of this publication. It does not represent the opinion of the EC, which is not responsible for any use that might be made of data appearing therein. Publisher Copyright: {\textcopyright} 2010-2012 IEEE.",

year = "2021",

month = apr,

doi = "10.1109/TAFFC.2019.2906200",

language = "English",

volume = "12",

pages = "293--305",

journal = "IEEE Transactions on Affecticve Computing",

issn = "1949-3045",

publisher = "IEEE",

number = "2",

}

TY - JOUR

T1 - An architecture for emotional facial expressions as social signals

AU - Aylett, Ruth

AU - Ritter, Christopher

AU - Lim, Mei Yii

AU - Broz, Frank

AU - McKenna, Peter

AU - Keller, Ingo

AU - Rajendran, Gnanathusharan

N1 - Funding Information: The authors would like to thank members of the project ECUTE (ICT-5-4.2257666), whose work was partially supported by the European Commission (EC). The authors are solely responsible for the content of this publication. It does not represent the opinion of the EC, which is not responsible for any use that might be made of data appearing therein. Publisher Copyright: © 2010-2012 IEEE.

PY - 2021/4

Y1 - 2021/4

N2 - We focus on affective architecture issues relating to the generation of expressive facial behaviour, critique approaches that treat expressive behaviour as only a mirror of internal state rather than as also a social signal and discuss the advantages of combining the two approaches. Using the FAtiMA architecture, we analyse the requirements for generating expressive behavior as social signals at both reactive and cognitive levels. We discuss how facial expressions can be generated in a dynamic fashion. We propose generic architectural mechanisms to meet these requirements based on an explicit mind-body loop and Theory of Mind (ToM) processing. A illustrative scenario is given.

AB - We focus on affective architecture issues relating to the generation of expressive facial behaviour, critique approaches that treat expressive behaviour as only a mirror of internal state rather than as also a social signal and discuss the advantages of combining the two approaches. Using the FAtiMA architecture, we analyse the requirements for generating expressive behavior as social signals at both reactive and cognitive levels. We discuss how facial expressions can be generated in a dynamic fashion. We propose generic architectural mechanisms to meet these requirements based on an explicit mind-body loop and Theory of Mind (ToM) processing. A illustrative scenario is given.

KW - Intelligent agents

KW - affective computing

KW - cognitive informatics

KW - interactive systems

KW - software architecture

UR - http://www.scopus.com/inward/record.url?scp=85107117274&partnerID=8YFLogxK

U2 - 10.1109/TAFFC.2019.2906200

DO - 10.1109/TAFFC.2019.2906200

M3 - Article

SN - 1949-3045

VL - 12

SP - 293

EP - 305

JO - IEEE Transactions on Affecticve Computing

JF - IEEE Transactions on Affecticve Computing

IS - 2

ER -

An architecture for emotional facial expressions as social signals

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Ruth Aylett

Cite this

An architecture for emotional facial expressions as social signals

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Profiles

Ruth Aylett

Cite this