VR Gaze Tracking for Focal Depth and Resource Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR/AR/MR systems face challenges in accurately determining a user's point of focus, leading to suboptimal 3D viewing experiences due to vergence-accommodation conflict and limited hardware resources.

Innovation Solution

The method involves tracking a user's gaze path and analyzing 3D data to identify virtual objects along the gaze path, determining the depth of the focal point by projecting all content onto a single depth plane corresponding to the user's point of focus, thereby minimizing vergence-accommodation conflict.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple depth planes are used to display virtual objects at different depths, then the 3D viewing experience is enhanced, but the system resource demands increase and processing complexity increases

Engineering Contradiction:
Improve3D viewing experienceVSAvoidsystem resource demands
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the display into multiple depth planes, where each plane renders virtual objects at a specific depth. This allows the system to manage complex 3D scenes by dividing them into manageable layers, improving rendering efficiency and reducing overall system resource demands while maintaining enhanced 3D viewing experience.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the number and positioning of depth planes based on the user's gaze path and the distribution of virtual objects. When objects are concentrated at a single depth, the system reduces to a single plane, minimizing resource usage. When objects span multiple depths, the system activates additional planes accordingly, optimizing the balance between viewing experience and system resources.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the display system renders all virtual objects at their respective depth planes, then depth accuracy is improved, but processing time increases and productivity decreases

Engineering Contradiction:
Improvedepth accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system applies partial rendering by focusing computational resources only on depth planes that contain virtual objects within the user's current gaze path. Instead of rendering all objects at all depths, the system selectively activates only the necessary depth planes, maintaining depth accuracy for relevant objects while significantly reducing processing time and improving productivity.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If the system tracks and analyzes user gaze path in real-time, then focal point determination accuracy is improved, but device complexity and energy consumption increase

Engineering Contradiction:
Improvefocal point determination accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary gaze tracking and depth analysis to predict which depth planes will be needed before full rendering begins. By pre-identifying the user's focal point and the depth distribution of relevant virtual objects, the system can prepare and activate only the necessary depth planes, improving focal point determination accuracy while reducing energy consumption through selective processing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250044865A1Virtual, augmented, and mixed reality systems and methods
Publication Date: 2025.02.06 MAGIC LEAP INC
  • US20250044865A1 patent drawing
  • US20250044865A1 patent drawing
  • US20250044865A1 patent drawing

AI summary

A method for determining a focal point depth of a user of a three-dimensional (ā€œ3Dā€) display device includes tracking a first gaze path of the user. The method also includes analyzing 3D data to identify one or more virtual objects along the first gaze path of the user. The method further includes when only one virtual object intersects the first gaze path of the user identifying a depth of the only one virtual object as the focal point depth of the user.