Relighting with the reflected irradiance field: Representation, sampling and reconstruction

Zhouchen Lin, Tien-Tsin Wong, Heung-Yeung Shum

Research output: Contribution to journalArticleResearchpeer-review

21 Citations (Scopus)

Abstract

Image-based relighting (IBL) is a technique to change the illumination of an image-based object/scene. In this paper, we define a representation called the reflected irradiance field which records the light reflected from a scene as viewed at a fixed viewpoint as a result of moving a point light source on a plane. It synthesizes a novel image under a different illumination by interpolating and superimposing appropriate recorded samples. Furthermore, we study the minimum sampling problem of the reflected irradiance field, i.e., how many light source positions are needed. We find that there exists a geometry-independent bound for the sampling interval whenever the second-order derivatives of the surface BRDF and the minimum depth of the scene are bounded. This bound ensures that when the novel light source is on the plane, the error in the reconstructed image is controlled by a given tolerance, regardless of the geometry. We also analyze the bound of depth error so that the extra reconstruction error can also be governed when the novel light source is off-plane. Experiments on both synthetic and real surfaces are conducted to verify our analysis.

Original languageEnglish
Article number5095648
Pages (from-to)229-246
Number of pages18
JournalInternational Journal of Computer Vision
Volume49
Issue number2-3
DOIs
Publication statusPublished - Sept 2002
Externally publishedYes

Keywords

  • BRDF
  • Image-based rendering
  • Light field
  • Lumigraph
  • Plenoptic functions
  • Relighting
  • Sampling

Cite this