Unsupervised dense Light Field reconstruction with occlusion awareness

Lixia Ni, Haiyong Jiang, Jianfei Cai, Jianmin Zheng, Haifeng Li, Xu Liu

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)

Abstract

Light field (LF) reconstruction is a fundamental technique in light field imaging and has applications in both software and hardware aspects. This paper presents an unsupervised learning method for LF-oriented view synthesis, which provides a simple solution for generating quality light fields from a sparse set of views. The method is built on disparity estimation and image warping. Specifically, we first use per-view disparity as a geometry proxy to warp input views to novel views. Then we compensate the occlusion with a network by a forward-backward warping process. Cycle-consistency between different views are explored to enable unsupervised learning and accurate synthesis. The method overcomes the drawbacks of fully supervised learning methods that require large labeled training dataset and epipolar plane image based interpolation methods that do not make full use of geometry consistency in LFs. Experimental results demonstrate that the proposed method can generate high quality views for LF, which outperforms unsupervised approaches and is comparable to fully-supervised approaches.

Original languageEnglish
Pages (from-to)425-436
Number of pages12
JournalComputer Graphics Forum
Volume38
Issue number7
DOIs
Publication statusPublished - Oct 2019
Externally publishedYes

Keywords

  • CCS Concepts
  • Computing methodologies → Image processing and computer vision
  • Reconstruction

Cite this