Coupled dictionary learning for multimodal image super-resolution

Pingfan Song, João F. C. Mota, Nikos Deligiannis, Miguel Raul Dias Rodrigues

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (SciVal)


Real-world data processing problems often involve multiple data modalities, e.g., panchromatic and multispectral images, positron emission tomography (PET) and magnetic resonance imaging (MRI) images. As these modalities capture information associated with the same phenomenon, they must necessarily be correlated, although the precise relation is rarely known. In this paper, we propose a coupled dictionary learning (CDL) framework to automatically learn these relations. In particular, we propose a new data model to characterize both similarities and discrepancies between multimodal signals in terms of common and unique sparse representations with respect to a group of coupled dictionaries. However, learning these coupled dictionaries involves solving a highly non-convex structural dictionary learning problem. To address this problem, we design a coupled dictionary learning algorithm, referred to sequential recursive optimization (SRO) algorithm, to sequentially learn these dictionaries in a recursive manner. By capitalizing on our model and algorithm, we conceive a CDL based multimodal image super-resolution (SR) approach. Practical multispectral image SR experiments demonstrate that our SR approach outperforms the bicubic interpolation and the state-of-the-art dictionary learning based image SR approach, with Peak-SNR (PSNR) gains of up to 8.2 dB and 5.1 dB, respectively.

Original languageEnglish
Title of host publication2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Number of pages5
ISBN (Electronic)9781509045457
Publication statusPublished - 24 Apr 2017
Event2016 IEEE Global Conference on Signal and Information Processing - Washington, United States
Duration: 7 Dec 20169 Dec 2016


Conference2016 IEEE Global Conference on Signal and Information Processing
Abbreviated titleGlobalSIP 2016
Country/TerritoryUnited States


  • Coupled dictionary learning
  • Multimodal data
  • Multispectral image super-resolution
  • Sequential recursive optimization
  • Sparse representation

ASJC Scopus subject areas

  • Signal Processing
  • Computer Networks and Communications


Dive into the research topics of 'Coupled dictionary learning for multimodal image super-resolution'. Together they form a unique fingerprint.

Cite this