High-speed object detection using SPAD sensors

German Mora-Martín, Alex Turpin, Alice Ruget, Abderrahim Halimi, Robert Henderson, Jonathan Leach, Istvan Gyongy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

72 Downloads (Pure)

Abstract

3D-imaging is used in a wide range of applications such as robotics, computer interfaces, autonomous driving or even capturing the flight of birds. Current systems are often based on stereoscopy or structured light approaches, which impose limitations on standoff distance (range), and require textures in the scene or accurate projection patterns. Furthermore, there may be significant computational requirements for the generation of 3D maps. This work considers a system based on the alternative approach of time-of-flight. A state-of-the art single-photon avalanche diode (SPAD) image sensor is used in combination with pulsed, flood-type illumination. The sensor generates photon timing histograms in pixel, achieving a photon throughput of 100’s of Gigaphotons per second. This in turn enables the capture of 3D maps at frame rates >1kFPS, even in high ambient conditions and with minimal latency. We present initial results on processing data frames from the sensor (in the form of 64×32, 16-bin timing histograms, and 256×128 photon counts) using convolutional neural networks, with the view to localize and classify objects in the field of view, with low latency. In tests involving three different hand signs, with data frames acquired with millisecond exposures, a classification accuracy of >90% is obtained, with histogram-based classification consistently outperforming intensity based processing, despite the former’s relatively low lateral resolution. The total, GPU-assisted, processing time for detecting and classifying a sign is under 25 ms. We believe these results are relevant to robotics or self-driving cars, where fast perception, exceeding human reaction times is often desired.
Original languageEnglish
Title of host publicationPhotonic Instrumentation Engineering VIII
EditorsYakov Soskind, Lynda E. Busse
PublisherSPIE
ISBN (Electronic)9781510642218
DOIs
Publication statusPublished - 5 Mar 2021

Publication series

NameProceedings of SPIE
Volume11693
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Keywords

  • 3D-imaging
  • LiDAR
  • Neural Networks
  • Object Detection
  • SPAD
  • Time-of-flight

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'High-speed object detection using SPAD sensors'. Together they form a unique fingerprint.

Cite this