TY - GEN
T1 - An advanced learning environment aided by recognition of multi-modal social signals
AU - Chen, Jingying
AU - Chen, Dan
AU - Wang, Lizhe
AU - Lemon, Oliver
PY - 2010
Y1 - 2010
N2 - In this study, we established an advanced learning environment that aims to promote learning of social communication skills for children especially those with Autism Spectrum Disorder. The learning environment estimates in real time the affective & cognitive state of a child via recognition of multimodal social signals, and generates interactive narratives with embodied virtual characters. One of the key components of the environment is the Visual Inputs Processor, which is the first that has the capabilities of detecting a child's attention and expression simultaneously in a natural environment. Furthermore, those have been enabled in a nonintrusive manner which avoids potential bias to the user's behaviours introduced by intrusive counterparts. The environment also employs multiple inexpensive cameras and a large multi-touch screen, and these settings (1) maximize of space and angles in which observation may be performed and (2) provide users with a much more realistic experience than counterpart approaches do. © 2010 Springer-Verlag Berlin Heidelberg.
AB - In this study, we established an advanced learning environment that aims to promote learning of social communication skills for children especially those with Autism Spectrum Disorder. The learning environment estimates in real time the affective & cognitive state of a child via recognition of multimodal social signals, and generates interactive narratives with embodied virtual characters. One of the key components of the environment is the Visual Inputs Processor, which is the first that has the capabilities of detecting a child's attention and expression simultaneously in a natural environment. Furthermore, those have been enabled in a nonintrusive manner which avoids potential bias to the user's behaviours introduced by intrusive counterparts. The environment also employs multiple inexpensive cameras and a large multi-touch screen, and these settings (1) maximize of space and angles in which observation may be performed and (2) provide users with a much more realistic experience than counterpart approaches do. © 2010 Springer-Verlag Berlin Heidelberg.
KW - Intelligent system
KW - Learning environment
KW - Pattern recognition
KW - Social communication skills
U2 - 10.1007/978-3-642-17407-0_5
DO - 10.1007/978-3-642-17407-0_5
M3 - Conference contribution
SN - 364217406X
SN - 9783642174063
VL - 6483 LNCS
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 41
EP - 51
BT - Advances in Web-Based Learning, ICWL 2010 - 9th International Conference, Proceedings
T2 - Optical Transmission Systems, Switching, and Subsystems VIII
Y2 - 8 December 2010 through 12 December 2010
ER -