Multifocal Plane DIBR Rendering for Stereoscopic Viewpoint Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing near-eye displays for virtual and augmented reality struggle with lower visual quality due to inadequate support for viewpoint changes, particularly when users turn their eyes, leading to disocclusions and vergence-accommodation conflicts, especially in stereoscopic rendering systems.
Innovation Solution
A method and device using multifocal plane (MFP) technology to generate stereoscopic viewpoints dynamically, allowing users to change their head tilt and viewing position freely by adjusting disparity and orientation in real-time, using depth plus texture content formats and depth blending functions to create high-quality stereoscopic content with natural motion parallax.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If stereoscopic rendering is used with near-eye displays, then visual quality is improved, but viewpoint changes are not supported leading to disocclusions and vergence-accommodation conflicts
Solution Approach 1:
The image is divided into multiple focal planes instead of a single plane, allowing different portions of the image to be focused at different depths. This segmentation enables the system to support viewpoint changes while maintaining visual quality by rendering each focal plane independently with appropriate disparity adjustments.
Solution Approach 2:
The system dynamically adjusts the disparity and orientation of multiple focal planes in real-time based on detected user head motion and eye position. This dynamic adaptation allows the stereoscopic rendering to maintain high visual quality while supporting natural viewpoint changes as users move their heads and eyes.
2Adaptability or versatility
If focal planes are shifted and oriented according to head movement, then viewpoint changes are supported, but visual quality deteriorates due to disocclusions
Solution Approach 1:
The system pre-calculates and prepares multiple focal planes with anticipated disparity adjustments before viewpoint changes occur. By having multiple focal planes ready with pre-computed disparity information, the system can smoothly transition between viewpoints without creating visible disocclusions or quality degradation.
Solution Approach 2:
Multiple intermediate focal planes are introduced between the original image plane and the display, acting as intermediaries that gradually transition the disparity information. This intermediary approach prevents abrupt changes that cause disocclusions, maintaining visual quality while enabling viewpoint changes.
3Object-affected harmful factors
If multiple focal planes are used to support natural accommodation, then accommodation-vergence conflict is reduced, but device complexity increases
Solution Approach 1:
The patent replaces complex mechanical multi-plane display systems with computational methods that generate multiple focal planes through image processing. By using depth maps and disparity calculations instead of physical multi-plane optics, the system reduces device complexity while maintaining the ability to support natural accommodation and reduce accommodation-vergence conflict.
Data Source
Figure 1A
Figure 1B
Figure 2A~2B
AI summary
A method comprising generating a plurality of focal plane images using a description of three-dimensional (3D) content; receiving motion information, wherein the motion information comprises information describing motion of a user relative to a real world environment; shifting one or more focal plane images of the plurality of focal plane images to generate transversal motion parallax in response to the motion information indicating transversal motion of the user; scaling one or more focal plane images of the plurality of focal plane images to generate axial motion parallax in response to the motion information indicating axial motion of the user; and rendering a view of the 3D content using the shifted and scaled focal plane images.