Fast Scalable Image Restoration using Total Variation Priors and Expectation Propagation

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
35 Downloads (Pure)


This paper presents a scalable approximate Bayesian method for image restoration using Total Variation (TV) priors, with the ability to offer uncertainty quantification. In contrast to most optimization methods based on maximum a posteriori estimation, we use the Expectation Propagation (EP) framework to approximate minimum mean squared error (MMSE) estimates and marginal (pixel-wise) variances, without resorting to Monte Carlo sampling. For the classical anisotropic TV-based prior, we also propose an iterative scheme to automatically adjust the regularization parameter via Expectation Maximization (EM). Using Gaussian approximating densities with diagonal covariance matrices, the resulting method allows highly parallelizable steps and can scale to large images for denoising, deconvolution, and compressive sensing (CS) problems. The simulation results illustrate that such EP methods can provide a posteriori estimates on par with those obtained via sampling methods but at a fraction of the computational cost. Moreover, EP does not exhibit strong underestimation of posteriori variances, in contrast to variational Bayes alternatives.
Original languageEnglish
Pages (from-to)5762-5773
Number of pages12
JournalIEEE Transactions on Image Processing
Early online date1 Sept 2022
Publication statusPublished - 2022


  • Variational inference
  • expectation maximization (EM)
  • expectation propagation (EP)
  • hyperparameter estimation
  • image restoration

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Fast Scalable Image Restoration using Total Variation Priors and Expectation Propagation'. Together they form a unique fingerprint.

Cite this