Bayesian computation with generative diffusion models by Multilevel Monte Carlo

Luke Shaw*, Abdul-Lateef Haji-Ali, Marcelo Pereyra, Konstantinos C. Zygalakis

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

13 Downloads (Pure)

Abstract

Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a 4×-to-8× reduction in computational cost with respect to standard techniques across three benchmark imaging problems.
Original languageEnglish
Article number20240333
JournalPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
Volume383
Issue number2299
DOIs
Publication statusPublished - 19 Jun 2025

Keywords

  • inverse problems
  • diffusion models
  • Multilevel Monte Carlo

Fingerprint

Dive into the research topics of 'Bayesian computation with generative diffusion models by Multilevel Monte Carlo'. Together they form a unique fingerprint.

Cite this