Near-eye display wavefront analysis for eye aberration compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Near-eye displays struggle to provide clear, immersive 3D graphics due to user eye aberrations, leading to blurry or distorted imagery and cognitive fatigue, as existing solutions require impractical corrective eyewear or inconsistent depth cues.

Innovation Solution

A near-eye display system that characterizes user eye aberrations through wavefront distortion estimation, using an array of light projecting and detecting elements to project and capture a light spot pattern, allowing for dynamic adjustment of lightfield frame rendering to compensate for eye imperfections and match the user's accommodation state.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the near-eye display renders images assuming the user's eye is free of substantial aberrations, then the display system remains simple and lightweight, but the displayed imagery becomes blurry or distorted when the user has refractive errors

Engineering Contradiction:
Improvedisplay system complexityVSAvoidimage clarity
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The system performs preliminary characterization of the user's eye aberrations by analyzing reflected light patterns from the cornea before rendering images. This pre-characterization allows the rendering system to pre-compensate for aberrations, ensuring clear imagery without requiring corrective lenses or complex real-time adjustment mechanisms during viewing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The rendering system dynamically adjusts rendering parameters based on the characterized eye aberrations. By changing parameters such as focal plane position, elemental image positioning, and optical compensation values according to the measured aberration profile, the system maintains image clarity while keeping the overall device design simple and lightweight.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If the near-eye display is designed to accommodate users with refractive errors, then image clarity improves, but the form factor becomes impractical due to weight and size increases from corrective lenses

Engineering Contradiction:
Improveimage clarityVSAvoiddisplay system weight
Core Design Contradiction:
Manufacturing precisionVSWeight of moving object

Solution Approach 1:

The system extracts and compensates for the corrective function from traditional physical corrective lenses. By using computational methods to characterize and compensate for eye aberrations through software-based rendering adjustments, the system removes the need for physical corrective lenses, thereby maintaining image clarity while avoiding the weight and size penalties of optical correction devices.

Inventive Principle:
Principle #2Taking out (Extraction)

3Device complexity

If the near-eye display uses a fixed focal plane for rendering, then the device structure remains simple, but cognitive fatigue occurs when the user's accommodation state does not match the focal plane

Engineering Contradiction:
Improvefocusing mechanism complexityVSAvoiduser comfort
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system implements dynamic focal plane adjustment based on the user's real-time accommodation state. By continuously monitoring eye focus through reflected light analysis and dynamically repositioning the focal plane in the rendered lightfield, the system maintains consistency between the user's accommodation state and the display focal plane, eliminating cognitive fatigue while keeping the physical device structure relatively simple.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms where the user's accommodation state is continuously measured through eye tracking and reflected light analysis, and this information feeds back to adjust the rendering focal plane in real-time. This closed-loop control ensures the display adapts to the user's natural focusing behavior, improving comfort without requiring complex mechanical focusing mechanisms.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables clear, immersive 3D graphics without the need for corrective lenses, by dynamically adjusting the rendering to match the user's eye characteristics, resulting in a smaller, lighter, and more effective display form factor.

Implementation Method 1

the display panel incorporates both an array of light projecting elements (infrared (IR) light projecting diodes, for example) to transmit a pattern of light spots toward the eye through the lenslet array

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

an array of light detecting elements (photodiodes, for example) to capture a reflection of the light spot pattern from the structures of the eye as a pattern reflection image

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

transmit a pattern of light spots toward the eye through the lenslet array

Methodology Applied
Scientific EffectLight refraction and focusing: Refraction

Data Source

PatentUS10629105B2Near-eye display with frame rendering based on reflected wavefront analysis for eye characterization
Publication Date: 2020.04.21 GOOGLE LLC
  • US10629105B2 patent drawing
  • US10629105B2 patent drawing
  • US10629105B2 patent drawing

AI summary

A near-eye display system includes an array of lenslets overlying a display panel. The display panel includes an array of light projecting elements, each light projecting element being coaxial with an axis of a corresponding lenslet. The display panel further includes an array of light detecting elements and an array of sub-pixel elements. The system further includes a control component configured to activate the array of light projecting elements to project a pattern of light spots toward an eye of the user and to control the array of light detecting elements to capture an image representing a reflection of the projected pattern of light spots from the eye. The system also includes an analysis component to determine displacements between expected positions and actual positions of at least a subset of light spots in the captured image, and to characterize the eye based on the displacements.