Multi-frame decomposition method for image rendering on multilayer displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing displays struggle to accurately represent three-dimensional scenes by emitting light fields that mimic natural light distributions, which are crucial for correct depth perception and retinal focus cues, requiring high angular density and fidelity in light ray emission.
Innovation Solution
A method for operating a display device that involves determining a target beam value, partitioning it into beam value partitions, and iteratively adjusting transmittance values of controllable-transparency pixels to minimize error terms, using non-negative tensor factorization to optimize light emission based on internal optical paths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a display emits light fields with high angular density to accurately represent three-dimensional scenes, then depth perception and retinal focus cues are improved, but the complexity of producing and controlling such light fields increases
Solution Approach 1:
The patent segments the light field into multiple discrete light rays, each corresponding to a specific viewing direction and depth plane. This allows the complex task of rendering a complete light field to be broken down into manageable components that can be processed and controlled independently through the multilayer display structure.
Solution Approach 2:
The patent introduces temporal multiplexing as an additional dimension to control light emission. By sequentially activating different layers of the display at different time intervals, the system achieves precise control over light rays in three-dimensional space without requiring complex simultaneous control of all spatial dimensions.
2Reliability
If a display uses multiple display paradigms to improve visual experience, then the quality of three-dimensional representation is improved, but the computational and control requirements increase
Solution Approach 1:
The rendering process is segmented into distinct stages: dividing the scene into depth planes, generating light rays for each plane, and assigning them to specific display layers. This segmentation allows complex rendering computations to be performed systematically and efficiently, reducing overall computational burden while maintaining visual quality.
Solution Approach 2:
The patent employs temporal multiplexing where different display layers are activated in periodic sequences. This periodic activation pattern allows the system to render multiple depth planes and view angles through time-division, reducing the computational complexity required for each individual frame while maintaining high visual fidelity.
3Measurement precision
If a display produces synthetic light fields with high fidelity to mimic real light fields, then depth perception is improved, but the difficulty of producing accurate light ray distributions increases
Solution Approach 1:
The patent introduces controllable transparency layers as intermediaries between the light source and the viewer. These layers act as mediators that can be independently adjusted to control the transmission of light rays, providing a simplified interface for achieving precise light field fidelity without directly controlling complex optical paths.
Solution Approach 2:
The patent replaces complex mechanical optical control systems with a computational approach using controllable transparency layers. Instead of physically manipulating optical components to control light ray distribution, the system uses software-controlled transparency values to achieve the same effect, simplifying the control mechanism while maintaining high light field fidelity.
Data Source
AI summary
Systems and methods are described for displaying a light field using a display device in which a plurality of internal light paths contribute to each respective output beam and in which each light path traverses at least one controllable-transparency pixel of the display. In example methods, a target light field is partitioned into a plurality of light field partitions that sum to the target light field. Each light field partition is associated with a subset of the internal light paths. Pixel values of the display device are selected to minimize a total error in each path's contribution to its corresponding light field partition. Methods described herein may be used to select pixel values in display devices that include a diffractive element, such as a diffraction grating.