Dynamic Distortion Compensation for Removable Lens Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices with displays, such as head-mounted displays, often suffer from geometric distortion due to lens assemblies, which can cause eye fatigue, visual discomfort, and chromatic aberration, and existing compensation methods fail to adequately account for varying viewer positions and gaze directions.

Innovation Solution

The implementation of dynamic geometric distortion compensation using ray tracing and eye-tracking systems to determine the distortion caused by both fixed and removable lens elements, allowing for real-time adjustment of images to correct for distortion based on the viewer's position and gaze direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If a lens assembly is used to focus light from the display panel towards the viewer, then the display can be viewed through the lens assembly, but geometric distortion occurs causing eye fatigue and visual discomfort

Engineering Contradiction:
Improvelight focusing efficiencyVSAvoidgeometric distortion
Core Design Contradiction:
Use of energy by moving objectVSObject-affected harmful factors

Solution Approach 1:

The system applies preliminary anti-action by pre-distorting the image content in the opposite direction of the expected lens distortion. The distortion compensation module calculates compensation parameters based on lens characteristics and applies inverse distortion to the display content before it reaches the lens assembly, so that the lens distortion and pre-applied compensation cancel each other out, resulting in a undistorted final image for the user.

Inventive Principle:
Principle #9Preliminary anti-action

Solution Approach 2:

The system changes parameters by dynamically adjusting distortion compensation parameters based on detected eye position and gaze direction. The distortion compensation module modifies image distortion parameters in real-time according to the user's viewing state, allowing the compensation to adapt to different viewing conditions and maintain optimal image quality across various eye positions.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If static distortion compensation is applied, then some distortion is reduced, but it fails to account for varying viewer positions and gaze directions

Engineering Contradiction:
Improvedistortion compensation accuracyVSAvoidviewer position adaptability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system transitions from static to dynamic distortion compensation by continuously tracking eye position and gaze direction using sensors. The distortion compensation parameters are dynamically updated based on real-time eye tracking data, allowing the system to adapt to varying viewer positions and maintain accurate distortion compensation across the entire field of view rather than being limited to a fixed viewing position.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback by using eye tracking sensors to detect the user's eye position and gaze direction, then feeding this information back to the distortion compensation module. The compensation parameters are continuously adjusted based on this feedback loop, ensuring that the distortion compensation remains accurate as the user moves their eyes or head, thereby improving both precision and adaptability.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If ray tracing is used to determine geometric distortion for removable lens elements, then accurate compensation can be achieved, but computational complexity increases

Engineering Contradiction:
Improvedistortion measurement accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies preliminary action by pre-calculating and storing distortion characteristics for different removable lens elements during a setup or calibration phase. When a lens is installed, the system retrieves the pre-computed distortion parameters rather than performing complex ray tracing calculations in real-time, significantly reducing computational complexity while maintaining measurement precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses copying by creating lookup tables or stored models of distortion characteristics for each removable lens element type. Instead of performing computationally intensive ray tracing for every frame, the system copies and applies pre-computed distortion parameters that match the installed lens, achieving accurate compensation with minimal real-time computation.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively reduces eye fatigue, improves visual comfort, mitigates geometric distortion, and enhances content registration by dynamically compensating for lens-induced distortions, ensuring accurate image presentation across different viewer positions and gaze directions.

Implementation Method 1

Light from the display panel may be focused by a lens assembly towards a viewer

Methodology Applied
Scientific EffectLight focusing: Lens

Implementation Method 2

Images from these cameras may be analyzed to determine when a removable lens element such as removable lens element 42-2 has been added to lens assembly 42

Methodology Applied
Scientific EffectOptical reflection: Reflection

Data Source

PatentUS11927757B1Electronic device display having distortion compensation
Publication Date: 2024.03.12 APPLE INC
  • US11927757B1 patent drawing
  • US11927757B1 patent drawing
  • US11927757B1 patent drawing

AI summary

An electronic device may have a display panel with an array of display pixels. Light from the display panel may be focused by a lens assembly towards a viewer. The presence of the lens assembly may cause geometric distortion for a viewer viewing images on the display through the lens assembly. To mitigate geometric distortion, geometric distortion compensation may be performed in the electronic device. The electronic device may include both a fixed lens element and a removable lens element in the lens assembly. The removable lens element may be changed, allowing the distortion function associated with the lens assembly to change over time. To dynamically compensate for geometric distortion caused by a lens assembly with a removable lens, ray tracing may be used to determine the geometric distortion caused by the lens assembly depending upon the particular removable lens that is present in the lens assembly.