FatigueView: A Multi-Camera Video Dataset for Vision-Based Drowsiness Detection

Cong Yang, Zhenyu Yang, Weiyu Li, John See

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)
125 Downloads (Pure)

Abstract

Although vision-based drowsiness detection approaches have achieved great success on empirically organized datasets, it remains far from being satisfactory for deployment in practice. One crucial issue lies in the scarcity and lack of datasets that represent the actual challenges in real-world applications, e.g. tremendous variation and aggregation of visual signs, challenges brought on by different camera positions and camera types. To promote research in this field, we introduce a new large-scale dataset, FatigueView, that is collected by both RGB and infrared (IR) cameras from five different positions. It contains real sleepy driving videos and various visual signs of drowsiness from subtle to obvious, e.g. with 17,403 different yawning sets totaling more than 124 million frames, far more than recent actively used datasets. We also provide hierarchical annotations for each video, ranging from spatial face landmarks and visual signs to temporal drowsiness locations and levels to meet different research requirements. We structurally evaluate representative methods to build viable baselines. With FatigueView, we would like to encourage the community to adapt computer vision models to address practical real-world concerns, particularly the challenges posed by this dataset.

Original languageEnglish
Pages (from-to)233-246
Number of pages14
JournalIEEE Transactions on Intelligent Transportation Systems
Volume24
Issue number1
Early online date27 Oct 2022
DOIs
Publication statusPublished - Jan 2023

Keywords

  • Annotations
  • autonomous vehicles
  • Cameras
  • driver monitoring system
  • Drowsiness detection
  • intelligent cockpit
  • Intelligent transportation systems
  • Mouth
  • Training data
  • Vehicles
  • Visualization

ASJC Scopus subject areas

  • Automotive Engineering
  • Mechanical Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'FatigueView: A Multi-Camera Video Dataset for Vision-Based Drowsiness Detection'. Together they form a unique fingerprint.

Cite this