Region-of-interest compression and view synthesis for light field video streaming
Wang, Bing, Peng, Qiang, Wang, Eric, Han, Kang, and Xiang, Wei (2019) Region-of-interest compression and view synthesis for light field video streaming. IEEE Access, 7. pp. 41183-41192.
PDF (Published Version)
- Published Version
Restricted to Repository staff only |
Abstract
Light field videos provide a rich representation of real-world, thus the research of this technology is of urgency and interest for both the scientific community and industries. Light field applications such as virtual reality and post-production in the movie industry require a large number of viewpoints of the captured scene to achieve an immersive experience, and this creates a significant burden on light field compression and streaming. In this paper, we first present a light field video dataset captured with a plenoptic camera. Then a new region-of-interest (ROI)-based video compression method is designed for light field videos. In order to further improve the compression performance, a novel view synthesis algorithm is presented to generate arbitrary viewpoints at the receiver. The experimental evaluation of four light field video sequences demonstrates that the proposed ROI-based compression method can save 5%-7% in bitrates in comparison to conventional light field video compression methods. Furthermore, the proposed view synthesis-based compression method not only can achieve a reduction of about 50% in bitrates against conventional compression methods, but the synthesized views can exhibit identical visual quality as their ground truth.
Item ID: | 58129 |
---|---|
Item Type: | Article (Research - C1) |
ISSN: | 2169-3536 |
Keywords: | light field, video compression, region-of-interest, view synthesis, light field video dataset |
Copyright Information: | © 2019 IEEE. |
Additional Information: | This article is available Open Access via the publisher's website. |
Funders: | Beijing Natural Science Foundation (BNSF), National Natural Science Foundation of China (NNSF), Foundation for Department of Transportation of Henan Province (FDT), China Scholarship Council (CSC) |
Projects and Grants: | BNSF Grant L182032, NNSF Grant 61772436, FDT 2019J-2-2, CSC Grant 201707000093 |
Date Deposited: | 24 Apr 2019 07:41 |
FoR Codes: | 40 ENGINEERING > 4009 Electronics, sensors and digital hardware > 400999 Electronics, sensors and digital hardware not elsewhere classified @ 100% |
More Statistics |