A novel occlusion-aware vote cost for light field depth estimation

Han, Kang, Xiang, Wei, Wang, Eric, and Huang, Tao (2021) A novel occlusion-aware vote cost for light field depth estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence. (In Press)

[img] PDF (Accepted Publisher Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: https://doi.org/10.1109/TPAMI.2021.31055...
 
2


Abstract

Conventional light field depth estimation methods build a cost volume that measures the photo-consistency of pixels refocused to a range of depths, which works well in most regions but usually generates blurry edges in the estimated depth map due to occlusions. Existing occlusion handling methods rely on complex edge-aided processing and post-refinement, and this reliance limits the resultant depth accuracy and impacts on the computational performance. In this paper, we propose a novel occlusion-aware vote cost (OAVC) which is able to accurately preserve edges in the depth map. Instead of using photo-consistency as an indicator of the correct depth, we construct a novel cost from a new perspective that counts the number of refocused pixels whose deviations from the central-view pixel is less than a small threshold, and utilizes that number to select the correct depth. The pixels from occluders are thus excluded in determining the correct depth. Without the use of any explicit occlusion handling methods, the proposed method can inherently preserve edges and produces high-quality depth estimates. Experimental results show that the proposed OAVC outperforms state-of-the-art light field depth estimation methods in terms of depth estimation accuracy and the computational performance.

Item ID: 69771
Item Type: Article (Research - C1)
ISSN: 1939-3539
Keywords: Light field, depth estimation, occlusion-aware, vote cost
Copyright Information: © 2021 IEEE.
Date Deposited: 02 Nov 2021 23:55
FoR Codes: 40 ENGINEERING > 4009 Electronics, sensors and digital hardware > 400999 Electronics, sensors and digital hardware not elsewhere classified @ 100%
SEO Codes: 20 HEALTH > 2002 Evaluation of health and support services > 200208 Telehealth @ 100%
Downloads: Total: 2
Last 12 Months: 2
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page