Supporting children's social communication skills through interactive narratives with virtual characters

Mary Ellen Foster; Katerina Avramides; Sara Bernardini; Jingying Chen; Christopher Frauenberger; Oliver Lemon; Kaska Porayska-Pomsta

doi:10.1145/1873951.1874163

Supporting children's social communication skills through interactive narratives with virtual characters

Mary Ellen Foster, Katerina Avramides, Sara Bernardini, Jingying Chen, Christopher Frauenberger, Oliver Lemon, Kaska Porayska-Pomsta

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

17 Citations (Scopus)

Abstract

The development of social communication skills in children relies on multimodal aspects of communication such as gaze, facial expression, and gesture. We introduce a multimodal learning environment for social skills which uses computer vision to estimate the children's gaze direction, processes gestures from a large multi-touch screen, estimates in real time the affective state of the users, and generates interactive narratives with embodied virtual characters. We also describe how the structure underlying this system is currently being extended into a general framework for the development of interactive multimodal systems. © 2010 ACM.

Original language	English
Title of host publication	Proceedings of the International Conference on Multimedia
Place of Publication	New York
Publisher	Association for Computing Machinery
Pages	1111-1114
Number of pages	4
ISBN (Print)	9781605589336
DOIs	https://doi.org/10.1145/1873951.1874163
Publication status	Published - 2010
Event	18th ACM International Conference on Multimedia ACM Multimedia 2010 - Firenze, Italy Duration: 25 Oct 2010 → 29 Oct 2010

Conference

Conference	18th ACM International Conference on Multimedia ACM Multimedia 2010
Abbreviated title	MM'10
Country/Territory	Italy
City	Firenze
Period	25/10/10 → 29/10/10

Keywords

technology-enhanced learning

Access to Document

10.1145/1873951.1874163

Cite this

Foster, M. E., Avramides, K., Bernardini, S., Chen, J., Frauenberger, C., Lemon, O., & Porayska-Pomsta, K. (2010). Supporting children's social communication skills through interactive narratives with virtual characters. In Proceedings of the International Conference on Multimedia (pp. 1111-1114). Association for Computing Machinery. https://doi.org/10.1145/1873951.1874163

@inproceedings{8e705dbf9f344961a86da620955cebbb,

title = "Supporting children's social communication skills through interactive narratives with virtual characters",

abstract = "The development of social communication skills in children relies on multimodal aspects of communication such as gaze, facial expression, and gesture. We introduce a multimodal learning environment for social skills which uses computer vision to estimate the children's gaze direction, processes gestures from a large multi-touch screen, estimates in real time the affective state of the users, and generates interactive narratives with embodied virtual characters. We also describe how the structure underlying this system is currently being extended into a general framework for the development of interactive multimodal systems. {\textcopyright} 2010 ACM.",

keywords = "technology-enhanced learning",

author = "Foster, {Mary Ellen} and Katerina Avramides and Sara Bernardini and Jingying Chen and Christopher Frauenberger and Oliver Lemon and Kaska Porayska-Pomsta",

year = "2010",

doi = "10.1145/1873951.1874163",

language = "English",

isbn = "9781605589336",

pages = "1111--1114",

booktitle = "Proceedings of the International Conference on Multimedia",

publisher = "Association for Computing Machinery",

address = "United States",

note = "18th ACM International Conference on Multimedia ACM Multimedia 2010, MM'10 ; Conference date: 25-10-2010 Through 29-10-2010",

}

Foster, ME, Avramides, K, Bernardini, S, Chen, J, Frauenberger, C, Lemon, O & Porayska-Pomsta, K 2010, Supporting children's social communication skills through interactive narratives with virtual characters. in Proceedings of the International Conference on Multimedia. Association for Computing Machinery, New York, pp. 1111-1114, 18th ACM International Conference on Multimedia ACM Multimedia 2010, Firenze, Italy, 25/10/10. https://doi.org/10.1145/1873951.1874163

Supporting children's social communication skills through interactive narratives with virtual characters. / Foster, Mary Ellen; Avramides, Katerina; Bernardini, Sara et al.
Proceedings of the International Conference on Multimedia. New York: Association for Computing Machinery, 2010. p. 1111-1114.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Supporting children's social communication skills through interactive narratives with virtual characters

AU - Foster, Mary Ellen

AU - Avramides, Katerina

AU - Bernardini, Sara

AU - Chen, Jingying

AU - Frauenberger, Christopher

AU - Lemon, Oliver

AU - Porayska-Pomsta, Kaska

PY - 2010

Y1 - 2010

N2 - The development of social communication skills in children relies on multimodal aspects of communication such as gaze, facial expression, and gesture. We introduce a multimodal learning environment for social skills which uses computer vision to estimate the children's gaze direction, processes gestures from a large multi-touch screen, estimates in real time the affective state of the users, and generates interactive narratives with embodied virtual characters. We also describe how the structure underlying this system is currently being extended into a general framework for the development of interactive multimodal systems. © 2010 ACM.

AB - The development of social communication skills in children relies on multimodal aspects of communication such as gaze, facial expression, and gesture. We introduce a multimodal learning environment for social skills which uses computer vision to estimate the children's gaze direction, processes gestures from a large multi-touch screen, estimates in real time the affective state of the users, and generates interactive narratives with embodied virtual characters. We also describe how the structure underlying this system is currently being extended into a general framework for the development of interactive multimodal systems. © 2010 ACM.

KW - technology-enhanced learning

UR - http://www.scopus.com/inward/record.url?scp=78650985503&partnerID=8YFLogxK

U2 - 10.1145/1873951.1874163

DO - 10.1145/1873951.1874163

M3 - Conference contribution

SN - 9781605589336

SP - 1111

EP - 1114

BT - Proceedings of the International Conference on Multimedia

PB - Association for Computing Machinery

CY - New York

T2 - 18th ACM International Conference on Multimedia ACM Multimedia 2010

Y2 - 25 October 2010 through 29 October 2010

ER -

Supporting children's social communication skills through interactive narratives with virtual characters

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this