Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers

Julián Tachella, Yoann Altmann, Nicolas Mellado, Aongus McCarthy, Rachael Tobin, Gerald Stuart Buller, Jean-Yves Tourneret, Stephen McLaughlin

Research output: Contribution to journalArticle

Abstract

Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20 ms, where the lidar data was acquired in broad daylight from distances up to 320 metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.
Original languageEnglish
Article number4984
JournalNature Communications
Volume10
DOIs
Publication statusPublished - 1 Nov 2019

Fingerprint

plugs
optical radar
photons
computer graphics
pixels

ASJC Scopus subject areas

  • Chemistry(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Physics and Astronomy(all)

Cite this

@article{cccf23cee1ec4e9f85041dbf0c5546b1,
title = "Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers",
abstract = "Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20 ms, where the lidar data was acquired in broad daylight from distances up to 320 metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.",
author = "Juli{\'a}n Tachella and Yoann Altmann and Nicolas Mellado and Aongus McCarthy and Rachael Tobin and Buller, {Gerald Stuart} and Jean-Yves Tourneret and Stephen McLaughlin",
year = "2019",
month = "11",
day = "1",
doi = "10.1038/s41467-019-12943-7",
language = "English",
volume = "10",
journal = "Nature Communications",
issn = "2041-1723",
publisher = "Nature Publishing Group",

}

Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers. / Tachella, Julián; Altmann, Yoann; Mellado, Nicolas; McCarthy, Aongus; Tobin, Rachael; Buller, Gerald Stuart; Tourneret, Jean-Yves; McLaughlin, Stephen.

In: Nature Communications, Vol. 10, 4984, 01.11.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers

AU - Tachella, Julián

AU - Altmann, Yoann

AU - Mellado, Nicolas

AU - McCarthy, Aongus

AU - Tobin, Rachael

AU - Buller, Gerald Stuart

AU - Tourneret, Jean-Yves

AU - McLaughlin, Stephen

PY - 2019/11/1

Y1 - 2019/11/1

N2 - Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20 ms, where the lidar data was acquired in broad daylight from distances up to 320 metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.

AB - Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20 ms, where the lidar data was acquired in broad daylight from distances up to 320 metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.

UR - http://www.scopus.com/inward/record.url?scp=85074344584&partnerID=8YFLogxK

U2 - 10.1038/s41467-019-12943-7

DO - 10.1038/s41467-019-12943-7

M3 - Article

VL - 10

JO - Nature Communications

JF - Nature Communications

SN - 2041-1723

M1 - 4984

ER -