Direct Retinal Projector Dynamic Focus for VR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual reality (VR) and augmented reality (AR) systems suffer from accommodation-convergence mismatch issues, leading to eyestrain, headaches, and nausea due to the brain being confused by depth cues that do not match the stereo convergence of the two eyes, causing a conflict between the focus and convergence distances.

Innovation Solution

The implementation of dynamic focusing components and techniques in direct retinal projector systems, which scan images pixel by pixel onto the retinas, allowing individual pixels to be dynamically focused based on depth information, ensuring that content at different depths is projected at the correct depths, thereby reducing or eliminating the convergence-accommodation conflict.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional VR systems project images onto screens for viewing, then the display can be viewed by the subject, but accommodation-convergence mismatch occurs causing eyestrain and headaches

Engineering Contradiction:
Improveuser comfortVSAvoideyestrain and headaches
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent replaces conventional screen-based optical projection with direct retinal projection, where light is scanned pixel-by-pixel directly onto the subject's retina. This substitution eliminates the intermediate screen and allows dynamic focusing at different depths, resolving the accommodation-convergence mismatch that causes eyestrain and headaches in conventional systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements dynamic focusing capability where each pixel can be focused at different depths according to depth information in the image. This dynamic adjustment of focus distance for different pixels allows the system to match accommodation with convergence at various depths, eliminating the fixed focal plane limitation of conventional screens and reducing eyestrain.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If dynamic focusing components are added to directly project images onto retinas, then individual pixels can be dynamically focused, but device complexity increases

Engineering Contradiction:
Improvefocus precisionVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the light emitting device into multiple independently controllable light emitting elements or groups of elements, each capable of being focused at different depths. This segmentation allows precise control of focus for each pixel or pixel group, enabling dynamic focusing while managing complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the focus distance parameter dynamically for different pixels based on depth information. By adjusting the focus parameter of individual light emitting elements or groups according to the depth of content being displayed, the system achieves precise focusing without requiring a completely different optical architecture, thus managing complexity through parameter control.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If images are scanned pixel by pixel onto retinas, then dynamic focusing is enabled, but the scanning process increases time consumption

Engineering Contradiction:
Improvedynamic focusing capabilityVSAvoidscanning time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent implements continuous scanning of light emitting elements across the field of view while maintaining dynamic focusing capability. By continuously updating the focus state of elements during the scanning process rather than switching between focus states after scanning, the system reduces idle time and maintains versatile dynamic focusing throughout the entire frame rate, minimizing time loss.

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution effectively reduces or eliminates the convergence-accommodation conflict, enhancing user comfort and reducing mental stress by ensuring that content is projected at the correct depths, improving the overall VR and AR experience.

Implementation Method 1

The light emitting elements in each light emitting device may, for example, include edge emitting lasers, vertical cavity surface emitting lasers (VCSELs), or other types of light emitting elements, for example light emitting diodes (LEDs)

Methodology Applied
Scientific EffectLight emission: Light Emitting Diode

Implementation Method 2

an array of focusing microlenses may be arranged in front of the light emitting device, with a microlens corresponding to each light emitting element, and with the microlenses corresponding to each of focus groups 1-N configured to focus at the respective focus distance f1-fN of the group

Methodology Applied
Scientific EffectFocusing: Focusing

Data Source

PatentUS11889045B2Dynamic focus 3D display
Publication Date: 2024.01.30 APPLE INC
  • US11889045B2 patent drawing
  • US11889045B2 patent drawing
  • US11889045B2 patent drawing

AI summary

A direct retinal projector system that provides dynamic focusing for virtual reality (VR) and/or augmented reality (AR) is described. A direct retinal projector system scans images, pixel by pixel, directly onto the subject's retinas. This allows individual pixels to be optically affected dynamically as the images are scanned to the subject's retinas. Dynamic focusing components and techniques are described that may be used in a direct retinal projector system to dynamically and correctly focus each pixel in VR images as the images are being scanned to a subject's eyes. This allows objects, surfaces, etc. that are intended to appear at different distances in a scene to be projected to the subject's eyes at the correct depths.