A non-coverage field model for improving the rendering quality of virtual views

Changjian Zhu, Li Yu, Zixiang Xiong

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Rendering quality optimization theory is one of the most basic and fascinating components of image-based rendering (IBR). The rendering quality of virtual views is related to the information in the source images. Capturing the image information depends on the geometric configuration of the camera (GCC) and, in particular, the positions and shooting directions of the cameras. Therefore, the rendering quality of virtual views can be improved by optimizing the GCC. This paper investigates the relationship between the GCC and the geometric configurations of the virtual view (GCVV). The influence of the GCC on the rendering quality is also analyzed. Based on the relationships among the GCC, GCVV and rendering quality, a mathematical model of the non-coverage field (NCF) is proposed to quantify the rendering quality. The performance of the NCF is also analyzed using a set of GCVVs and GCCs. Furthermore, an optimization algorithm based on the NCF that simultaneously optimizes the position and direction of the GCC is presented. The proposed technique can be applied to obtain the optimal rendering quality of IBR for the linear case of camera positions and virtual views. Finally, experimental results are presented and compared with the theoretical results.

Original languageEnglish
Pages (from-to)738-753
Number of pages16
JournalIEEE Transactions on Multimedia
Volume20
Issue number3
DOIs
Publication statusPublished - 2018

Keywords

  • camera
  • geomettic configuration
  • Image-based rendering
  • rendering quality assessment
  • virtual view

Cite this

Zhu, Changjian ; Yu, Li ; Xiong, Zixiang. / A non-coverage field model for improving the rendering quality of virtual views. In: IEEE Transactions on Multimedia. 2018 ; Vol. 20, No. 3. pp. 738-753.
@article{2550ad77090148f5bef31588ce8d6898,
title = "A non-coverage field model for improving the rendering quality of virtual views",
abstract = "Rendering quality optimization theory is one of the most basic and fascinating components of image-based rendering (IBR). The rendering quality of virtual views is related to the information in the source images. Capturing the image information depends on the geometric configuration of the camera (GCC) and, in particular, the positions and shooting directions of the cameras. Therefore, the rendering quality of virtual views can be improved by optimizing the GCC. This paper investigates the relationship between the GCC and the geometric configurations of the virtual view (GCVV). The influence of the GCC on the rendering quality is also analyzed. Based on the relationships among the GCC, GCVV and rendering quality, a mathematical model of the non-coverage field (NCF) is proposed to quantify the rendering quality. The performance of the NCF is also analyzed using a set of GCVVs and GCCs. Furthermore, an optimization algorithm based on the NCF that simultaneously optimizes the position and direction of the GCC is presented. The proposed technique can be applied to obtain the optimal rendering quality of IBR for the linear case of camera positions and virtual views. Finally, experimental results are presented and compared with the theoretical results.",
keywords = "camera, geomettic configuration, Image-based rendering, rendering quality assessment, virtual view",
author = "Changjian Zhu and Li Yu and Zixiang Xiong",
year = "2018",
doi = "10.1109/TMM.2017.2750409",
language = "English",
volume = "20",
pages = "738--753",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
number = "3",

}

A non-coverage field model for improving the rendering quality of virtual views. / Zhu, Changjian; Yu, Li; Xiong, Zixiang.

In: IEEE Transactions on Multimedia, Vol. 20, No. 3, 2018, p. 738-753.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - A non-coverage field model for improving the rendering quality of virtual views

AU - Zhu, Changjian

AU - Yu, Li

AU - Xiong, Zixiang

PY - 2018

Y1 - 2018

N2 - Rendering quality optimization theory is one of the most basic and fascinating components of image-based rendering (IBR). The rendering quality of virtual views is related to the information in the source images. Capturing the image information depends on the geometric configuration of the camera (GCC) and, in particular, the positions and shooting directions of the cameras. Therefore, the rendering quality of virtual views can be improved by optimizing the GCC. This paper investigates the relationship between the GCC and the geometric configurations of the virtual view (GCVV). The influence of the GCC on the rendering quality is also analyzed. Based on the relationships among the GCC, GCVV and rendering quality, a mathematical model of the non-coverage field (NCF) is proposed to quantify the rendering quality. The performance of the NCF is also analyzed using a set of GCVVs and GCCs. Furthermore, an optimization algorithm based on the NCF that simultaneously optimizes the position and direction of the GCC is presented. The proposed technique can be applied to obtain the optimal rendering quality of IBR for the linear case of camera positions and virtual views. Finally, experimental results are presented and compared with the theoretical results.

AB - Rendering quality optimization theory is one of the most basic and fascinating components of image-based rendering (IBR). The rendering quality of virtual views is related to the information in the source images. Capturing the image information depends on the geometric configuration of the camera (GCC) and, in particular, the positions and shooting directions of the cameras. Therefore, the rendering quality of virtual views can be improved by optimizing the GCC. This paper investigates the relationship between the GCC and the geometric configurations of the virtual view (GCVV). The influence of the GCC on the rendering quality is also analyzed. Based on the relationships among the GCC, GCVV and rendering quality, a mathematical model of the non-coverage field (NCF) is proposed to quantify the rendering quality. The performance of the NCF is also analyzed using a set of GCVVs and GCCs. Furthermore, an optimization algorithm based on the NCF that simultaneously optimizes the position and direction of the GCC is presented. The proposed technique can be applied to obtain the optimal rendering quality of IBR for the linear case of camera positions and virtual views. Finally, experimental results are presented and compared with the theoretical results.

KW - camera

KW - geomettic configuration

KW - Image-based rendering

KW - rendering quality assessment

KW - virtual view

UR - http://www.scopus.com/inward/record.url?scp=85030689716&partnerID=8YFLogxK

U2 - 10.1109/TMM.2017.2750409

DO - 10.1109/TMM.2017.2750409

M3 - Article

VL - 20

SP - 738

EP - 753

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 3

ER -