A comparison between fourier and Hadamard Single-Pixel Imaging in deep learning-enhanced image reconstruction

Jia You Lim, Muhammad Razin Roslan, Jun Yi Lim, Vishnu MonnBaskaran, Yeong Shiong Chiew, Raphael C.W. Phan, Xin Wang

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Many Single Pixel Imaging (SPI) schemes exist to reconstruct images, where the most notable schemes are Hadamard SPI (HSPI) and Fourier SPI (FSPI) effectively. To date, there exist comparisons between both methods, but only within the conventional optical image processing setting. With recent advancements in deep learning (DL), image restoration models exhibit considerable performance that could potentially be reformulated to enhance existing SPI schemes. In this work, we present the first-known comparison of conventional HSPI, FSPI, and their DL-enhanced variants, based on state-of-the-art NAFNet. The experiments are conducted by reconstructing images of the STL-10 dataset, followed by evaluations on the Set11, Set14, BSD68 and Urban100 test sets. Our experimental results show that DL-enhanced FSPI and HSPI achieved substantial performance gains on PSNR and SSIM. Interestingly, the improvement trend in PSNR for FSPI is inconsistent with HSPI due to the reconstructed graphical artifacts at higher sampling rates.

Original languageEnglish
Pages (from-to)2475-1472
Number of pages4
JournalIEEE Sensors Letters
Volume7
Issue number9
DOIs
Publication statusPublished - Sept 2023

Keywords

  • Compressed sensing
  • Compressive Sensing
  • Deep Learning
  • Deep learning
  • Image reconstruction
  • Image restoration
  • Imaging
  • Indexing
  • Real-time systems
  • Single-Pixel Imaging

Cite this