MCNeT: Measurement-Consistent Networks Via A Deep Implicit Layer For Solving Inverse Problems

Rahul Mourya, João F. C. Mota

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

End-to-end deep neural networks (DNNs) have become the state-of-the-art (SOTA) for solving inverse problems. Despite their outstanding performance, during deployment, such networks are sensitive to minor variations in the testing pipeline and often fail to reconstruct small but important details, a feature critical in medical imaging, astronomy, or defence. Such instabilities in DNNs can be explained by the fact that they ignore the forward measurement model during deployment, and thus fail to enforce consistency between their output and the input measurements. To overcome this, we propose a framework that transforms any DNN for inverse problems into a measurement-consistent one. This is done by appending to it an implicit layer (or deep equilibrium network) designed to solve a model-based optimization problem. The implicit layer consists of a shallow learnable network that can be integrated into the end-to-end training while keeping the SOTA DNN fixed. Experiments on single-image super-resolution show that the proposed framework leads to significant improvements in reconstruction quality and robustness over the SOTA DNNs.
Original languageEnglish
Title of host publication2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
PublisherIEEE
ISBN (Electronic)9781728163277
DOIs
Publication statusPublished - 5 May 2023

Keywords

  • ADMM
  • Image super-resolution
  • deep equilibrium networks
  • fixed-point iterations
  • implicit layers

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'MCNeT: Measurement-Consistent Networks Via A Deep Implicit Layer For Solving Inverse Problems'. Together they form a unique fingerprint.

Cite this