Robust 3D Reconstruction of Dynamic Scenes From Single-Photon Lidar Using Beta-Divergences

Quentin Legros, Julián Tachella, Rachael Tobin, Aongus McCarthy, Sylvain Meignen, Gerald Stuart Buller, Yoann Altmann, Stephen McLaughlin, Mike E. Davies

Research output: Contribution to journalArticlepeer-review

3 Downloads (Pure)

Abstract

In this article, we present a new algorithm for fast, online 3D reconstruction of dynamic scenes using times of arrival of photons recorded by single-photon detector arrays. One of the main challenges in 3D imaging using single-photon lidar in practical applications is the presence of strong ambient illumination which corrupts the data and can jeopardize the detection of peaks/surface in the signals. This background noise not only complicates the observation model classically used for 3D reconstruction but also the estimation procedure which requires iterative methods. In this work, we consider a new similarity measure for robust depth estimation, which allows us to use a simple observation model and a non-iterative estimation procedure while being robust to mis-specification of the background illumination model. This choice leads to a computationally attractive depth estimation procedure without significant degradation of the reconstruction performance. This new depth estimation procedure is coupled with a spatio-temporal model to capture the natural correlation between neighboring pixels and successive frames for dynamic scene analysis. The resulting online inference process is scalable and well suited for parallel implementation. The benefits of the proposed method are demonstrated through a series of experiments conducted with simulated and real single-photon lidar videos, allowing the analysis of dynamic scenes at 325 m observed under extreme ambient illumination conditions.
Original languageEnglish
Pages (from-to)1716-1727
Number of pages12
JournalIEEE Transactions on Image Processing
Volume30
Early online date31 Dec 2020
DOIs
Publication statusPublished - 2021

Keywords

  • 3D reconstruction
  • Bayesian filtering
  • Estimation
  • Image reconstruction
  • Imaging
  • Laser radar
  • Lighting
  • Photonics
  • Robust estimation
  • Single-photon lidar
  • Three-dimensional displays
  • Variational methods

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Robust 3D Reconstruction of Dynamic Scenes From Single-Photon Lidar Using Beta-Divergences'. Together they form a unique fingerprint.

Cite this