Depth-Component Image Rendering for VR Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for producing images in virtual reality systems suffer from latency issues due to the time required for rendering, leading to a lag in image updates when the user's head movement changes, causing discomfort such as dizziness and nausea.
Innovation Solution
The method involves rendering multiple component images corresponding to different depths within a scene, determining the view pose elements, and overlaying these components to produce an output image, allowing for efficient and accurate representation of the scene, including parallax effects, through independent transformations of each component image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single rendered image is transformed based on detected view pose changes, then the output image can more accurately reflect the current view pose, but the rendering process still causes latency and the user experience may not be fully improved
Solution Approach 1:
The patent segments the scene into multiple depth layers (foreground, midground, background) and renders each layer separately. This allows independent transformation of each layer based on its depth, enabling more accurate view pose representation while reducing overall rendering complexity and latency
Solution Approach 2:
The patent pre-renders multiple depth layers in advance before the actual view pose change occurs. When a view pose change is detected, the pre-rendered layers are quickly transformed and composited, significantly reducing the latency compared to rendering a complete image from scratch
2Measurement precision
If multiple depth layers are rendered and independently transformed, then parallax effects and view pose accuracy are significantly improved, but the device complexity and processing requirements increase
Solution Approach 1:
The scene is divided into discrete depth layers that can be independently processed. Each layer is assigned a specific depth range and transformation parameters, simplifying the complexity by organizing the rendering process into manageable segments rather than handling the entire scene as one complex unit
Solution Approach 2:
Different transformation operations are applied to different depth layers based on their local characteristics. Foreground layers receive different transformation parameters than background layers, allowing accurate parallax effects while optimizing processing by applying only necessary transformations to each layer
Data Source
AI summary
Aspects of the present disclosure relate to a method for producing an output image representing a scene. The method comprises rendering a plurality of component images. Each component image corresponds to an associated depth within the scene. The method comprises determining one or more elements of a view pose to which an output image is to correspond, and deriving an output image part from each of the plurality of component images based on the determined one or more elements. The method then comprises overlaying each of the output image parts, to produce the output image.