POL-LWIR Vehicle Detection: Convolutional Neural Networks Meet Polarised Infrared Sensors

Marcel Sheeny, Andrew Wallace, Mehryar Emambakhsh, Sen Wang, Barry Connor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)
102 Downloads (Pure)

Abstract

For vehicle autonomy, driver assistance and situational awareness, it is necessary to operate at day and night, and in all weather conditions. In particular, long wave infrared (LWIR) sensors that receive predominantly emitted radiation have the capability to operate at night as well as during the day. In this work, we employ a polarised LWIR (POL-LWIR) camera to acquire data from a mobile vehicle, to compare and contrast four different convolutional neural network (CNN) configurations to detect other vehicles in video sequences. We evaluate two distinct and promising approaches, two-stage detection (Faster-RCNN) and one-stage detection (SSD), in four different configurations. We also employ two different image decompositions: the first based on the polarisation ellipse and the second on the Stokes parameters themselves. To evaluate our approach, the experimental trials were quantified by mean average precision (mAP) and processing time, showing a clear trade-off between the two factors. For example, the best mAP result of 80.94 % was achieved using Faster-RCNN, but at a frame rate of 6.4 fps. In contrast, MobileNet SSD achieved only 64.51 % mAP, but at 53.4 fps.
Original languageEnglish
Title of host publication2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
PublisherIEEE
Pages1328-1334
Number of pages7
ISBN (Electronic)9781538661000
DOIs
Publication statusPublished - 17 Dec 2018
Event14th IEEE Workshop on Perception Beyond the Visible Spectrum in conjunction with CVPR 2018 - Salt Lake City, United States
Duration: 18 Jun 201818 Jun 2018

Workshop

Workshop14th IEEE Workshop on Perception Beyond the Visible Spectrum in conjunction with CVPR 2018
Abbreviated titlePBVS 2018
Country/TerritoryUnited States
CitySalt Lake City
Period18/06/1818/06/18

Fingerprint

Dive into the research topics of 'POL-LWIR Vehicle Detection: Convolutional Neural Networks Meet Polarised Infrared Sensors'. Together they form a unique fingerprint.

Cite this