Layered Depth Video Multi-Directional Occlusion Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current layered depth video formats, such as LDV, are limited to horizontal occlusion layers, failing to render multiple layer dis-occlusions in complex scenes with wide inter-axial distances, leading to inefficiencies in data transmission and processing.
Innovation Solution
A method and apparatus for generating layered depth data from light-field content that computes depth maps and occlusion information in multiple directions, merging these to create a unified occlusion layer, enabling the rendering of complex scenes with wide inter-axial distances by comparing images in horizontal and vertical directions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single horizontal occlusion layer is used in LDV format, then data transmission efficiency is improved by reducing redundancy, but the ability to render multiple layer dis-occlusions in complex scenes with wide inter-axial distances deteriorates
Solution Approach 1:
The patent introduces a second direction (vertical) distinct from the traditional horizontal direction and viewing direction, creating multi-directional occlusion information. This dimensional expansion allows the system to capture occlusions from multiple perspectives, enabling proper rendering of complex scenes with wide inter-axial distances while maintaining data efficiency through selective transmission of only necessary multi-directional occlusion data.
2Device complexity
If occlusion information is computed only in the horizontal direction, then processing complexity is reduced, but rendering accuracy for complex scenes deteriorates
Solution Approach 1:
The patent segments occlusion computation into multiple independent directional components (horizontal direction distinct from viewing direction, and vertical direction distinct from both viewing and horizontal directions). Each direction is processed separately to generate specific occlusion information, which can then be selectively combined. This segmentation reduces overall processing complexity by breaking down the complex 3D occlusion problem into manageable directional segments while maintaining high rendering accuracy through the inclusion of multi-directional data.
Data Source
AI summary
The invention relates to layered depth data. In multi-view images, there is a large amount of redundancy between images. Layered Depth Video format is a well-known formatting solution for formatting multi-view images which reduces the amount of redundant information between images. In LDV, a reference central image is selected and information brought by other images of the multi-view images that are mainly regions occluded in the central image are provided. However, LDV format contains a single horizontal occlusion layer, and thus fails rendering viewpoints that uncover multiple layers dis-occlusions. The invention uses light filed content which offers disparities in every directions and enables a change in viewpoint in a plurality of directions distinct from the viewing direction of the considered image enabling to render viewpoints that may uncover multiple layer dis-occlusions which may occurs with complex scenes viewed with wide inter-axial distance.