Spontaneous Macro and Micro Facial Expression Recognition Using ResNet50 and VLDSP

John Mendez, Md Azher Uddin*, Joolekha Bibi Joolee

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Facial expressions serve as the predominant means of conveying human emotions, and their understanding has garnered significant interest among researchers due to the wide array of real-world applications it encompasses. However, there is limited research conducted on the simultaneous recognition of spontaneous macro expressions and micro expressions. This study introduces an innovative end-to-end framework designed to effectively process videos for spontaneous macro and micro facial expression recognition. The framework integrates the extraction of deep spatial features through ResNet50, and handcrafted spatiotemporal features obtained from the application of Volume Local Directional Structural Pattern (VLDSP). Additionally, a novel 1D Convolutional Neural Network (CNN) is introduced to classify facial expressions, utilizing the extracted deep spatial features and spatiotemporal features as input. Finally, a comprehensive experiment is conducted to demonstrate the proposed framework performance.

Original languageEnglish
Title of host publicationProceedings of International Conference on Information Technology and Applications
EditorsAbrar Ullah, Sajid Anwar, Davide Calandra, Raffaele Di Fuccio
PublisherSpringer
Pages159-170
Number of pages12
ISBN (Electronic)9789819983247
ISBN (Print)9789819983230
DOIs
Publication statusPublished - 18 Mar 2024
Event16th International Conference on Information Technology and Applications 2022 - Lisbon, Portugal
Duration: 20 Oct 202222 Oct 2022

Publication series

NameLecture Notes in Networks and Systems
Volume839
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389

Conference

Conference16th International Conference on Information Technology and Applications 2022
Abbreviated titleICITA 2022
Country/TerritoryPortugal
CityLisbon
Period20/10/2222/10/22

Keywords

  • 1D convolutional neural network
  • ResNet50
  • Spontaneous macro and micro facial expression recognition
  • Volume local directional structural pattern

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Spontaneous Macro and Micro Facial Expression Recognition Using ResNet50 and VLDSP'. Together they form a unique fingerprint.

Cite this