Multiple Focal Planes for 3D Viewpoint Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for capturing and rendering 3D spaces struggle to maintain high detail and support natural 3D perception, as they often rely on simplifications and approximations that lose relevant cues and increase complexity.
Innovation Solution
The system enhances non-transparent 2D billboards by using transparent Multiple Focal Planes (MFPs) to support the perception of 3D shapes and focal distances, synthesizing new views by segmenting objects and moving them based on a viewer's position, and generating depth maps to form MFPs that improve 3D perception and reduce image corruption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If 3D captured spaces use simplifications and approximations to mimic natural viewing, then device complexity is reduced, but manufacturing precision of 3D perception is degraded
Solution Approach 1:
The view is segmented into multiple layers corresponding to different depth ranges. Each layer is processed independently to generate focal planes, allowing complex 3D scenes to be broken down into manageable components while preserving depth information for accurate 3D shape perception.
Solution Approach 2:
The patent transforms 2D image data into multiple focal planes by introducing a depth dimension. This is achieved by generating depth maps and using them to create stacked focal planes at different distances, enabling natural 3D perception without requiring complex multi-camera 3D capture systems.
2Ease of operation
If focal plane shifting is used to simulate motion parallax, then ease of operation for viewpoint change is improved, but manufacturing precision of image quality is degraded due to corruption
Solution Approach 1:
The system dynamically adjusts the number, position, and transparency of focal planes based on the desired viewpoint change. When simulating motion parallax, focal planes are selectively shifted along the depth axis while maintaining proper occlusion relationships, preventing image corruption while achieving natural viewpoint transitions.
Solution Approach 2:
The patent changes parameters such as focal plane distances, transparency values, and occlusion depths to simulate viewpoint changes. By adjusting these parameters dynamically, the system achieves motion parallax effects without the image corruption that occurs with simple focal plane shifting.
3Device complexity
If 2D billboards are used for viewpoint synthesis, then device complexity is reduced, but manufacturing precision of 3D shape perception is degraded
Solution Approach 1:
The patent enhances 2D billboards by introducing multiple focal planes at different depths. Each billboard is associated with one or more focal planes that contain depth information, transforming flat 2D representations into multi-layered structures that preserve 3D shape perception while keeping the overall system relatively simple.
Solution Approach 2:
The system creates a composite structure combining 2D billboard images with transparent focal planes. The billboards provide the visual content while the overlaid focal planes add depth information and enable 3D perception, creating a hybrid representation that leverages the simplicity of 2D images while achieving 3D effects.
4Manufacturing precision
If multiple focal planes are used to support accommodation, then manufacturing precision of focal distance perception is improved, but device complexity increases due to rendering requirements
Solution Approach 1:
The visual scene is segmented into multiple discrete focal planes, each representing a specific depth range. This segmentation allows the rendering system to process and manage depth information in manageable layers, improving focal distance accuracy while controlling computational complexity through organized layer management.
Data Source
AI summary
Systems and methods relate to segmenting texture data and depth data of first image data of a first viewpoint into layers; generating respective multiple focal planes (MFPs) for each respective layer; blanking out pixels on the respective MFPs for each respective layer that are occluded by pixels on layers that are closer to a first viewpoint; and generating second image data for a second viewpoint to enable display of the second image data by: shifting and scaling the respective MFPs for each respective layer corresponding to the second viewpoint, wherein layers closer to an origin of the second viewpoint are shifted and scaled more than layers farther from the origin of the second viewpoint; and blanking out pixels on the shifted and scaled respective MFPs for each respective layer that are occluded by pixels on layers that are closer to the second viewpoint.