Skip to main navigation Skip to search Skip to main content

Spatio-temporal motion adaptive graph convolutional network for facial micro-expression recognition

  • Shayhan Ameen Chowdhury
  • , Md Azher Uddin
  • , Young-Koo Lee*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Micro-expressions (MEs) are brief, involuntary facial movements that reveal genuine emotions and are valuable in applications such as lie detection and criminal investigation. Recent advances in micro-expression recognition (MER) have leveraged Graph Neural Networks to model facial sequences as spatio-temporal graphs, often enhanced with attention mechanisms to emphasize informative landmarks and critical frames. However, existing attention designs typically derive importance weights via learned transformations of intermediate features, which are not explicitly conditioned on sequence-specific motion cues. To address this issue, we propose the Spatio-Temporal Motion Adaptive Graph Convolutional Network (ST-MAGCN), which computes sample-specific landmark and frame weights from temporal feature differences, enabling motion-aware adaptation during inference. The core intuition is that facial regions and frames with greater motion variation carry more discriminative and complementary information. Moreover, we introduce complete graph convolution to capture long-range dependencies between facial landmarks, further enhancing the detection of fine-grained facial changes. Experiments on CASME II, SAMM, and SMIC demonstrate that our approach consistently outperforms existing methods and achieves notable improvements in MER.
Original languageEnglish
Article number137
JournalSignal, Image and Video Processing
Volume20
Issue number3
DOIs
Publication statusPublished - 9 Mar 2026

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 16 - Peace, Justice and Strong Institutions
    SDG 16 Peace, Justice and Strong Institutions

Keywords

  • Feature Refinement
  • Graph Convolutional Network (GCN)
  • Micro-Expression Recognition
  • Motion-Adaptive Modulation
  • Spatio-Temporal Modeling

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Spatio-temporal motion adaptive graph convolutional network for facial micro-expression recognition'. Together they form a unique fingerprint.

Cite this