Supporting children's social communication skills through interactive narratives with virtual characters

Mary Ellen Foster, Katerina Avramides, Sara Bernardini, Jingying Chen, Christopher Frauenberger, Oliver Lemon, Kaska Porayska-Pomsta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

The development of social communication skills in children relies on multimodal aspects of communication such as gaze, facial expression, and gesture. We introduce a multimodal learning environment for social skills which uses computer vision to estimate the children's gaze direction, processes gestures from a large multi-touch screen, estimates in real time the affective state of the users, and generates interactive narratives with embodied virtual characters. We also describe how the structure underlying this system is currently being extended into a general framework for the development of interactive multimodal systems. © 2010 ACM.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Multimedia
Place of PublicationNew York
PublisherAssociation for Computing Machinery
Pages1111-1114
Number of pages4
ISBN (Print)9781605589336
DOIs
Publication statusPublished - 2010
Event18th ACM International Conference on Multimedia ACM Multimedia 2010 - Firenze, Italy
Duration: 25 Oct 201029 Oct 2010

Conference

Conference18th ACM International Conference on Multimedia ACM Multimedia 2010
Abbreviated titleMM'10
CountryItaly
CityFirenze
Period25/10/1029/10/10

Keywords

  • technology-enhanced learning

Fingerprint Dive into the research topics of 'Supporting children's social communication skills through interactive narratives with virtual characters'. Together they form a unique fingerprint.

  • Cite this

    Foster, M. E., Avramides, K., Bernardini, S., Chen, J., Frauenberger, C., Lemon, O., & Porayska-Pomsta, K. (2010). Supporting children's social communication skills through interactive narratives with virtual characters. In Proceedings of the International Conference on Multimedia (pp. 1111-1114). Association for Computing Machinery. https://doi.org/10.1145/1873951.1874163