3D scene reconstruction by multiple structured-light based commodity depth cameras

Jianfeng Wang, Cha Zhang, Wenwu Zhu, Zhengyou Zhang, Zixiang Xiong, Philip A. Chou

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

29 Citations (Scopus)


Commodity depth cameras have attracted a lot of research interest recently, in particular the structured-light based Kinect cameras available on the mass market. One important application of such cameras is 3D scene reconstruction and view synthesis. However, a single depth camera often has limited field of view and there is missing depth information when synthesizing a virtual view from a new viewpoint. In this paper, we study the problem of 3D scene reconstruction from multiple structured-light based depth cameras. Since multiple cameras may cause severe interference in the regions where the projected light overlaps, we present a novel planesweeping based algorithm to handle such interference. The proposed algorithm takes into account the correlation between multiple projectors and the infrared images as well as the correlation between the infrared images, thereby recovering the depth information for both overlapped and non-overlapped regions. Simulation results demonstrate that the proposed solution is very effective on various scenes.

Original languageEnglish
Title of host publication2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Proceedings
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages4
ISBN (Print)9781467300469
Publication statusPublished - 2012
Externally publishedYes
EventIEEE International Conference on Acoustics, Speech and Signal Processing 2012 - Kyoto International Conference Center, Kyoto, Japan
Duration: 25 Mar 201230 Mar 2012
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=6268628 (Conference Proceedings)


ConferenceIEEE International Conference on Acoustics, Speech and Signal Processing 2012
Abbreviated titleICASSP 2012
Internet address


  • 3D scene reconstruction
  • multiple depth cameras
  • structured light

Cite this