6DoF VR Rendering Visibility Test for Artifact Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image-based rendering for 6 degree-of-freedom virtual reality often results in visual artifacts such as noise and distortion when hidden areas are revealed as the viewpoint moves, due to the complexity of calculating light and material interactions.
Innovation Solution
A system and method that performs a visibility test using 3D geometric information to determine invisible fragments for each reference viewpoint, selects an optimal reference viewpoint based on visibility information and expression scores, and applies image-based rendering using a color image and depth image corresponding to the final reference viewpoint.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If image-based rendering is used for 6 degree-of-freedom virtual reality, then real-time rendering performance is improved, but visual artifacts such as noise and distortion occur when hidden areas are revealed
Solution Approach 1:
The patent performs a visibility test before the actual rendering process to pre-identify invisible fragments. By determining which areas are hidden from reference viewpoints in advance, the system can avoid rendering these areas or handle them differently, thus preventing visual artifacts while maintaining real-time performance.
Solution Approach 2:
The patent introduces an intermediate visibility test module that acts as a mediator between the reference viewpoints and the final rendering process. This module generates visibility information that guides the rendering process, allowing the system to achieve both real-time performance and visual quality by selectively processing only visible areas.
2Manufacturing precision
If multiple reference viewpoints are used for rendering, then rendering quality is improved, but computational complexity increases
Solution Approach 1:
The patent extracts only the necessary reference viewpoints for rendering by performing visibility tests and selecting viewpoints that can actually contribute to the final image. This eliminates the need to process all possible reference viewpoints, reducing computational complexity while maintaining rendering quality.
Solution Approach 2:
The patent performs visibility tests and selects a subset of reference viewpoints rather than using all available viewpoints. This partial action approach is sufficient to achieve high rendering quality while significantly reducing the computational burden compared to processing all reference viewpoints.
3Measurement precision
If visibility test is performed for each reference viewpoint, then rendering accuracy is improved, but processing time increases
Solution Approach 1:
The patent merges the visibility test results from multiple reference viewpoints into a single visibility information map. By combining these tests efficiently and using the results to guide a single rendering process, the system achieves high rendering accuracy without multiplying the processing time by the number of reference viewpoints.
Data Source
AI summary
A system for rendering 6 degree-of-freedom virtual reality according to an embodiment of the present disclosure includes a visibility test module performing a visibility test for determining whether a current point of interest where a main viewpoint is directed is visible for each of a plurality of reference viewpoints and generating visibility information by identifying the number of invisible fragments of each reference viewpoint according to the performance result, a reference viewpoint selection module selecting a final reference viewpoint for a rendering process for a current frame based on the visibility information for each of the plurality of reference viewpoints and a preset selection criterion, and a rendering process module performing an image-based rendering process by using a color image and a depth image corresponding to the final reference viewpoint.