Neural Boneprint: Person Identification from Bones Using Generative Contrastive Deep Learning

Chaoqun Niu, Dongdong Chen, Jizhe Zhou, Jian Wang, Xiang Luo, Quan-Hui Liu, Yuan Li, Jiancheng Lv

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Forensic person identification is of paramount importance in accidents and criminal investigations. Existing methods based on soft tissue or DNA can be unavailable if the body is badly decomposed, white-ossified, or charred. However, bones last a long time. This raises a natural question: can we learn to identify a person using bone data? We present a novel feature of bones called Neural Boneprint for personal identification. In particular, we exploit the thoracic skeletal data including chest radiographs (CXRs) and computed tomography (CT) images enhanced by the volume rendering technique (VRT) as an example to explore the availability of the neural boneprint. We then represent the neural boneprint as a joint latent embedding of VRT images and CXRs through a bidirectional cross-modality translation and contrastive learning. Preliminary experimental results on real skeletal data demonstrate the effectiveness of the Neural Boneprint for identification. We hope that this approach will provide a promising alternative for challenging forensic cases where conventional methods are limited. The code is available at https://github.com/CheltonNiu/Neural-Boneprint.git.
Original languageEnglish
Title of host publicationMM '24: Proceedings of the 32nd ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery
Pages7609-7618
Number of pages10
ISBN (Print)9798400706868
DOIs
Publication statusPublished - 28 Oct 2024
Event32nd ACM International Conference on Multimedia 2024 - Melbourne, Australia
Duration: 28 Oct 20241 Nov 2024
Conference number: 32
https://icmsaust.com.au/event/acm-international-conference-for-multimedia-2024/

Conference

Conference32nd ACM International Conference on Multimedia 2024
Abbreviated titleMM '24
Country/TerritoryAustralia
CityMelbourne
Period28/10/241/11/24
Internet address

Keywords

  • bone
  • cross modality
  • cxr
  • generative model
  • neural boneprint
  • person identification
  • skeletal data
  • vrt

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'Neural Boneprint: Person Identification from Bones Using Generative Contrastive Deep Learning'. Together they form a unique fingerprint.

Cite this