Dual-stream Shallow Networks for Facial Micro-expression Recognition

Huai-Qian Khor, John See, Sze-Teng Liong, Raphael C. W. Phan, Weiyao Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

Micro-expressions are spontaneous, brief and subtle facial muscle movements that exposes underlying emotions. Motivated by recent exploits into deep learning for micro-expression analysis, we propose a lightweight dual-stream shallow network in the form of a pair of truncated CNNs with heterogeneous input features. The merging of the convolutional features allows for discriminative learning of micro-expression classes stemming from both streams. Using activation heatmaps, we further demonstrate that salient facial areas are well emphasized, and correspond closely to relevant action units belonging to emotion classes. We empirically validate the proposed network on three benchmark databases, obtaining state-of-the-art performance on the CASME II and SAMM while remaining competitive on the SMIC. Further observations point towards the sufficiency of utilizing shallower deep networks for micro-expression recognition.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Image Processing (ICIP)
PublisherIEEE
Pages36-40
Number of pages5
ISBN (Electronic)9781538662496
DOIs
Publication statusPublished - 26 Aug 2019
Event26th IEEE International Conference on Image Processing 2019 - Taipei, Taiwan, Province of China
Duration: 22 Sep 201925 Sep 2019

Publication series

NameInternational Conference on Image Processing
ISSN (Print)1522-4880
ISSN (Electronic)2381-8549

Conference

Conference26th IEEE International Conference on Image Processing 2019
Abbreviated titleICIP 2019
Country/TerritoryTaiwan, Province of China
CityTaipei
Period22/09/1925/09/19

Keywords

  • apex frame
  • dual-stream networks
  • Micro-expression
  • recognition
  • shallow CNN

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'Dual-stream Shallow Networks for Facial Micro-expression Recognition'. Together they form a unique fingerprint.

Cite this