Skip to main navigation Skip to search Skip to main content

Scaling Deep Learning for Material Imaging: A Pseudo-3d Model for Tera-Scale 3d Domain Transfer

  • Kunning Tang
  • , Ryan Armstrong
  • , Peyman Mostaghimi
  • , Yufu Niu
  • , Quentin Meyer
  • , Chuan Zhao
  • , Donal Finegan
  • , Melissa Popeil
  • , Kamaljit Singh
  • , Hannah Menke
  • , Alexandros Patsoukis Dimou
  • , Tom Bultreys
  • , Arjen Mascini
  • , Mark Knackstedt
  • , Ying Da Wang

Research output: Working paperPreprint

Abstract

The characterisation of the internal 3-dimensional (3D) structure of complex materials has been revolutionised with the use of deep-learning artificial intelligence. However, this process often requires neural networks that must be trained every time and remains computationally limited to 2D or relatively small 3D domains (10^8 voxels). Herein, we introduce a Pseudo-3D domain transfer network (P3T-Net) for transfer capable of inference on domains approaching the tera-scale (10^12 voxels), solving domain mismatch between trained networks and other inference inputs, third-axis misalignment of 2D networks on 3D data, and the limited inference size of memory-inefficient 3D networks on large-scale 3D data. Solving these interconnected challenges has enabled to use deep learning for multi-modal 3D large-scale nano/micro-CT imaging. Significant applications of domain transfer are demonstrated with both pixelwise accuracy and validation of physical metrics. These include (i) image quality enhancement of fast-scan for geological rock and hydrogen fuel cells, (ii) transferring single-mode images to dual-mode quality for lithium-ion battery which reduces the imaging time by 60%, (iii) accurate multi-label segmentation of images under different imaging conditions, and (iv) efficient large-scale 3D inference (10^12 voxels) on a single GPU. The outcomes of each application highlight the ability of P3T-Net to accurately and efficiently transfer 3D cross-domain images for a variety of materials in diverse conditions.
Original languageEnglish
DOIs
Publication statusPublished - 27 Apr 2024

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Fingerprint

Dive into the research topics of 'Scaling Deep Learning for Material Imaging: A Pseudo-3d Model for Tera-Scale 3d Domain Transfer'. Together they form a unique fingerprint.

Cite this