Unsupervised learning from incomplete measurements for inverse problems

Julián Tachella, Dongdong Chen, Mike E. Davies

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


In many real-world inverse problems, only incomplete measurement data are available for training which can pose a problem for learning a reconstruction function. Indeed, unsupervised learning using a fixed incomplete measurement process is impossible in general, as there is no information in the nullspace of the measurement operator. This limitation can be overcome by using measurements from multiple operators. While this idea has been successfully applied in various applications, a precise characterization of the conditions for learning is still lacking. In this paper, we fill this gap by presenting necessary and sufficient conditions for learning the underlying signal model needed for reconstruction which indicate the interplay between the number of distinct measurement operators, the number of measurements per operator, the dimension of the model and the dimension of the signals. Furthermore, we propose a novel and conceptually simple unsupervised learning loss which only requires access to incomplete measurement data and achieves a performance on par with supervised learning when the sufficient condition is verified. We validate our theoretical bounds and demonstrate the advantages of the proposed unsupervised loss compared to previous methods via a series of experiments on various imaging inverse problems, such as accelerated magnetic resonance imaging, compressed sensing and image inpainting.
Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 35
Number of pages13
ISBN (Electronic)9781713871088
Publication statusPublished - 2022
Event36th Conference on Neural Information Processing Systems 2022 - New Orleans Convention Center, New Orleans, United States
Duration: 28 Nov 20229 Dec 2022


Conference36th Conference on Neural Information Processing Systems 2022
Abbreviated titleNeurIPS 2022
Country/TerritoryUnited States
CityNew Orleans


Dive into the research topics of 'Unsupervised learning from incomplete measurements for inverse problems'. Together they form a unique fingerprint.

Cite this