TY - JOUR
T1 - Bayesian computation with generative diffusion models by Multilevel Monte Carlo
AU - Shaw, Luke
AU - Haji-Ali, Abdul-Lateef
AU - Pereyra, Marcelo
AU - Zygalakis, Konstantinos C.
N1 - Publisher Copyright:
© 2025 The Author(s). Published by the Royal Society. All rights reserved.
PY - 2025/6/19
Y1 - 2025/6/19
N2 - Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a 4×-to-8× reduction in computational cost with respect to standard techniques across three benchmark imaging problems.
AB - Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion models often require a large number of neural function evaluations per sample in order to deliver accurate posterior samples. As a result, using diffusion models as stochastic samplers for Monte Carlo integration in Bayesian computation can be highly computationally expensive, particularly in applications that require a substantial number of Monte Carlo samples for conducting uncertainty quantification analyses. This cost is especially high in large-scale inverse problems such as computational imaging, which rely on large neural networks that are expensive to evaluate. With quantitative imaging applications in mind, this paper presents a Multilevel Monte Carlo strategy that significantly reduces the cost of Bayesian computation with diffusion models. This is achieved by exploiting cost-accuracy trade-offs inherent to diffusion models to carefully couple models of different levels of accuracy in a manner that significantly reduces the overall cost of the calculation, without reducing the final accuracy. The proposed approach achieves a 4×-to-8× reduction in computational cost with respect to standard techniques across three benchmark imaging problems.
KW - inverse problems
KW - diffusion models
KW - Multilevel Monte Carlo
UR - https://www.scopus.com/pages/publications/105008979739
U2 - 10.1098/rsta.2024.0333
DO - 10.1098/rsta.2024.0333
M3 - Article
C2 - 40534295
SN - 1364-503X
VL - 383
JO - Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
JF - Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
IS - 2299
M1 - 20240333
ER -