Retina Space Display Stabilization for AR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted displays in virtual and augmented reality systems face challenges in stabilizing images relative to a user's retina space due to independent eye movements, leading to blurring issues, as conventional solutions like increased refresh rates and reduced persistence have limitations and drawbacks.

Innovation Solution

A system with stabilization actuators that adjust the image location in real-time based on detected head and eye motion, using sensors like inertial measurement units and gaze tracking systems to maintain image stability in the retina space, and combining virtual and physical image stabilization techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If the refresh rate of the display panel is increased to compensate for head and eye movement, then image stability in retina space is improved, but the required bandwidth and processing speed increase beyond physical and thermal constraints

Engineering Contradiction:
Improveimage stabilityVSAvoidrefresh rate
Core Design Contradiction:
Stability of the object's compositionVSSpeed

Solution Approach 1:

The patent replaces the software-based image stabilization approach (shifting rendered images) with a mechanical stabilization system that physically moves the display panel using stabilization actuators. This mechanical substitution allows the display to maintain a fixed position in retina space without requiring increased refresh rates or processing bandwidth

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces stabilization actuators as an intermediary mechanical component between the display panel and the head-mounted display frame. These actuators actively compensate for head and eye movements by physically adjusting the display panel's position, serving as a mediator that decouples the display stability requirement from the refresh rate requirements

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If the persistence of the display is decreased to reduce motion blur, then image clarity is improved, but the available brightness and component lifetime are compromised

Engineering Contradiction:
Improveimage clarityVSAvoidbrightness
Core Design Contradiction:
Stability of the object's compositionVSIllumination intensity

Solution Approach 1:

Instead of reducing persistence to improve clarity (the conventional approach), the patent inverts the approach by using mechanical stabilization to maintain image stability throughout the entire illumination period. This allows the display to operate with higher persistence values, maintaining both brightness and clarity simultaneously

Inventive Principle:
Principle #13The other way round (Inversion)

3Stability of the object's composition

If image frames are shifted on the display panel to compensate for motion, then image stability is improved, but detection precision decreases when moving more than a few pixels

Engineering Contradiction:
Improveimage stabilityVSAvoidimage position accuracy
Core Design Contradiction:
Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

The patent replaces the software-based image shifting approach with a mechanical system that physically positions the display panel. This mechanical substitution enables precise control of display panel position through actuator control, maintaining sub-pixel accuracy even for larger movements that would be undetectable through software rendering alone

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10948985B2Retina space display stabilization and a foveated display for augmented reality
Publication Date: 2021.03.16 NVIDIA CORP
  • US10948985B2 patent drawing
  • US10948985B2 patent drawing
  • US10948985B2 patent drawing

AI summary

Perceived clarity of an image presented by a display can be improved using an image stabilization technique to stabilize the image relative to a user's retina. During an illumination period, stabilization actuators are controlled to move a display panel or adjust optical components in the path of light associated with the image to shift the location of the image on the user's retina in response to head or eye movement detected by the system. In some embodiments, a display is configured to illuminate an image, and at least one stabilization actuator is configured to stabilize the image in a retina space associated with a user. Changes in the retina space can be detected by one or more sensors configured to detect a head position of the user and/or an orientation of the user's retina. The image is stabilized in retina space using the stabilization actuators.