Micro-expression recognition based on 3D flow convolutional neural network

Jing Li, Yandan Wang*, John See, Wenbin Liu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

145 Citations (Scopus)

Abstract

Micro-expression recognition (MER) is a growing field of research which is currently in its early stage of development. Unlike conventional macro-expressions, micro-expressions occur at a very short duration and are elicited in a spontaneous manner from emotional stimuli. While existing methods for solving MER are largely non-deep-learning-based methods, deep convolutional neural network (CNN) has shown to work very well on such as face recognition, facial expression recognition, and action recognition. In this article, we propose applying the 3D flow-based CNNs model for video-based micro-expression recognition, which extracts deeply learned features that are able to characterize fine motion flow arising from minute facial movements. Results from comprehensive experiments on three benchmark datasets—SMIC, CASME/CASME II, showed a marked improvement over state-of-the-art methods, hence proving the effectiveness of our fairly easy CNN model as the deep learning benchmark for facial MER.

Original languageEnglish
Pages (from-to)1331-1339
Number of pages9
JournalPattern Analysis and Applications
Volume22
Issue number4
Early online date8 Nov 2019
DOIs
Publication statusPublished - Nov 2019

Keywords

  • 3D CNN
  • CASME
  • Facial micro-expressions
  • Micro-expression recognition
  • Optical flow
  • SMIC

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Micro-expression recognition based on 3D flow convolutional neural network'. Together they form a unique fingerprint.

Cite this