High-quality Kinect depth filtering for real-time 3D telepresence

Mengyao Zhao, Fuwen Tan, Chi-Wing Fu, Chi-Keung Tang, Jianfei Cai, Tat Jen Cham

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

4 Citations (Scopus)

Abstract

3D telepresence is a next-generation multimedia application, offering remote users an immersive and natural video-conferencing environment with real-time 3D graphics. Kinect sensor, a consumer-grade range camera, facilitates the implementation of some recent 3D telepresence systems. However, conventional data filtering methods are insufficient to handle Kinect depth error because such error is quantized rather than just randomly-distributed. Hence, one could often observe large irregularly-shaped patches of pixels that receive the same depth values from Kinect. To enhance visual quality in 3D telepresence, we propose a novel depth data filtering method for Kinect by means of multi-scale and direction-aware support windows. In addition, we develop a GPU-based CUDA implementation that can perform real-time depth filtering. Results from the experiments show that our method can reconstruct hole-free surfaces that are smoother and less bumpy compared to existing methods like bilateral filtering.

Original languageEnglish
Title of host publication2013 IEEE International Conference on Multimedia and Expo, ICME 2013
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Print)9781479900152
DOIs
Publication statusPublished - 2013
Externally publishedYes
Event2013 IEEE International Conference on Multimedia and Expo, ICME 2013 - San Jose, CA, United States of America
Duration: 15 Jul 201319 Jul 2013

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2013 IEEE International Conference on Multimedia and Expo, ICME 2013
CountryUnited States of America
CitySan Jose, CA
Period15/07/1319/07/13

Keywords

  • 3D telepresence
  • direction-aware filtering
  • Kinect
  • multi-scale filtering

Cite this

Zhao, M., Tan, F., Fu, C-W., Tang, C-K., Cai, J., & Cham, T. J. (2013). High-quality Kinect depth filtering for real-time 3D telepresence. In 2013 IEEE International Conference on Multimedia and Expo, ICME 2013 (Proceedings - IEEE International Conference on Multimedia and Expo). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICME.2013.6607501