Dynamic Uniformity Correction for Waveguide Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Artificial reality systems, such as virtual and augmented reality, face challenges in compensating for waveguide non-uniformity, which causes visual artifacts and inaccuracies due to spatially varying light transmission characteristics across different eye positions, leading to flicker and color distortions.

Innovation Solution

A system that generates and applies correction maps based on current eye position and previous frames using eye tracking data, employing bicubic or bilinear interpolation to adjust image pixel values, and utilizes a temporal filter to optimize correction maps for smoother display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If correction maps are generated and applied based on eye position to compensate waveguide non-uniformity, then color accuracy and visual quality are improved, but system complexity and processing requirements increase

Engineering Contradiction:
Improvecolor accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system pre-generates correction maps for multiple discrete eye positions before runtime. These correction maps are stored in a lookup table, allowing the system to quickly retrieve and apply the appropriate correction without performing complex calculations during image display. This preliminary preparation resolves the contradiction by shifting computational complexity from runtime to setup phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically selects and interpolates between correction maps based on the user's current eye position, which changes over time. By using eye tracking data to determine the appropriate correction map and applying temporal filtering to smooth transitions, the system adapts to dynamic conditions while maintaining color accuracy without requiring complete recalculation for each frame.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If high-resolution correction maps are used to eliminate visual artifacts, then image quality is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The correction process is segmented into discrete eye positions with pre-generated correction maps. Instead of processing the entire high-resolution image continuously, the system divides the correction task into separate lookup tables for different eye positions, then selectively applies only the relevant segments based on current eye position. This segmentation reduces processing time while maintaining image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses temporal filtering that considers only a limited number of previous frames (e.g., the immediately preceding frame) rather than processing the entire history. This partial action approach provides sufficient smoothing to eliminate flicker and visual artifacts while avoiding the excessive computational burden of analyzing all past frames, thus reducing processing time.

Inventive Principle:
Principle #16Partial or excessive action

3Stability of the object's composition

If correction maps from previous frames are used to reduce flicker, then visual smoothness is improved, but temporal lag and responsiveness may worsen

Engineering Contradiction:
Improvevisual smoothnessVSAvoidtemporal lag
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The system applies periodic temporal filtering that smoothly transitions between correction maps of consecutive frames. By using a controlled filtering approach that blends current and previous correction maps in a periodic manner, the system eliminates flicker and achieves visual smoothness while maintaining a predictable and minimal temporal lag.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses eye tracking feedback to continuously monitor eye position and dynamically adjust which correction map is applied. This real-time feedback mechanism ensures that the most appropriate correction is applied with minimal delay, reducing temporal lag while the temporal filtering of previous frames provides the necessary smoothing to maintain visual smoothness.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11694302B2Dynamic uniformity correction
Publication Date: 2023.07.04 META PLATFORMS TECHNOLOGIES LLC
  • US11694302B2 patent drawing
  • US11694302B2 patent drawing
  • US11694302B2 patent drawing

AI summary

In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.