Region-of-interest compression and view synthesis for light field video streaming

Wang, Bing, Peng, Qiang, Wang, Eric, Han, Kang, and Xiang, Wei (2019) Region-of-interest compression and view synthesis for light field video streaming. IEEE Access, 7. pp. 41183-41192.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: https://doi.org/10.1109/ACCESS.2019.2907...


Abstract

Light field videos provide a rich representation of real-world, thus the research of this technology is of urgency and interest for both the scientific community and industries. Light field applications such as virtual reality and post-production in the movie industry require a large number of viewpoints of the captured scene to achieve an immersive experience, and this creates a significant burden on light field compression and streaming. In this paper, we first present a light field video dataset captured with a plenoptic camera. Then a new region-of-interest (ROI)-based video compression method is designed for light field videos. In order to further improve the compression performance, a novel view synthesis algorithm is presented to generate arbitrary viewpoints at the receiver. The experimental evaluation of four light field video sequences demonstrates that the proposed ROI-based compression method can save 5%-7% in bitrates in comparison to conventional light field video compression methods. Furthermore, the proposed view synthesis-based compression method not only can achieve a reduction of about 50% in bitrates against conventional compression methods, but the synthesized views can exhibit identical visual quality as their ground truth.

Item ID: 58129
Item Type: Article (Research - C1)
ISSN: 2169-3536
Keywords: light field, video compression, region-of-interest, view synthesis, light field video dataset
Copyright Information: © 2019 IEEE.
Additional Information:

This article is available Open Access via the publisher's website.

Funders: Beijing Natural Science Foundation (BNSF), National Natural Science Foundation of China (NNSF), Foundation for Department of Transportation of Henan Province (FDT), China Scholarship Council (CSC)
Projects and Grants: BNSF Grant L182032, NNSF Grant 61772436, FDT 2019J-2-2, CSC Grant 201707000093
Date Deposited: 24 Apr 2019 07:41
FoR Codes: 09 ENGINEERING > 0906 Electrical and Electronic Engineering > 090699 Electrical and Electronic Engineering not elsewhere classified @ 100%
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page