Estimating spatial layout of rooms from RGB-D videos

Anran Wang, Jiwen Lu, Jianfei Cai, Gang Wang, Tat-Jen Cham

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Spatial layout estimation of indoor rooms plays an important role in many visual analysis applications such as robotics and human-computer interaction. While many methods have been proposed for recovering spatial layout of rooms in recent years, their performance is still far from satisfactory due to high occlusion caused by the presence of objects that clutter the scene. In this paper, we propose a new approach to estimate the spatial layout of rooms from RGB-D videos. Unlike most existing methods which estimate the layout from still images, RGB-D videos provide more spatial-temporal and depth information, which are helpful to improve the estimation performance because more contextual information can be exploited in RGB-D videos. Given a RGB-D video, we first estimate the spatial layout of the scene in each single frame and compute the camera trajectory using the simultaneous localization and mapping (SLAM) algorithm. Then, the estimated spatial layouts of different frames are integrated to infer temporally consistent layouts of the room throughout the whole video. Our method is evaluated on the NYU RGB-D dataset, and the experimental results show the efficacy of the proposed approach.

Original languageEnglish
Title of host publication2014 IEEE International Workshop on Multimedia Signal Processing
EditorsFernando Pereira, Alexander Loui
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781479958962
DOIs
Publication statusPublished - 2014
Externally publishedYes
EventIEEE International Workshop on Multimedia Signal Processing 2014 - Jakarta, Indonesia
Duration: 22 Sep 201424 Sep 2014
Conference number: 16th
http://mmsp2014.ilearning.me/

Conference

ConferenceIEEE International Workshop on Multimedia Signal Processing 2014
Abbreviated titleMMSP 2014
CountryIndonesia
CityJakarta
Period22/09/1424/09/14
Internet address

Cite this