Virtual Content Display Modification Using Opposing Gaze-Head Motion

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The presentation of virtual content on devices can interfere with a user's ability to view objects in a physical or XR environment, necessitating a modification of the display to reduce interference.

Innovation Solution

Devices utilize eye tracking and head pose data to detect opposing movements of the gaze and head, modifying display characteristics such as transparency or ceasing display of virtual content to allow unobstructed viewing of objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual content is displayed on the device, then information delivery is improved, but the user's ability to view objects in the physical environment deteriorates

Engineering Contradiction:

Improveinformation deliveryVSAvoidviewing obstruction

Core Design Contradiction:

Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the display characteristics of virtual content adjustable and responsive to real-time user behavior. The system dynamically modifies transparency, position, or cessation of display based on detected gaze direction and head pose, allowing the display to adapt between showing virtual content and enabling clear viewing of physical objects as needed

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent applies local quality by selectively modifying display characteristics in different regions or conditions. When the user gazes at physical objects, the virtual content display is selectively adjusted (increased transparency or ceased) in the relevant visual field while maintaining normal display elsewhere, creating localized optimization of viewing experience

Inventive Principle:

Principle #3Local quality

2Ease of operation

If computer vision operations are performed to detect user intent, then viewing ability is improved, but computing resource consumption increases

Engineering Contradiction:

Improveviewing abilityVSAvoidcomputing resource consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent replaces complex computer vision operations with simpler sensor-based detection. Instead of using computational imaging and AI algorithms to infer user intent, the system directly utilizes data from eye trackers and head pose sensors, substituting mechanical/physical sensing with computational analysis, thereby reducing processing requirements while maintaining accurate detection of user viewing state

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12366917B1Modifying display of content based on gaze and head movement

Publication Date: 2025.07.22 APPLE INC

AI summary

Various implementations disclosed herein include devices, systems, and methods for modifying display of virtual content. In some implementations, the method is performed by an electronic device including a non-transitory memory, one or more processors, a display, an eye tracker and a movement sensor. In some implementations, the method includes displaying, via the display, virtual content. In some implementations, the method includes detecting, via the eye tracker, a movement of a gaze in a first direction. In some implementations, the method includes detecting, via the movement sensor, a movement of a head in a second direction while detecting the movement of the gaze in the first direction. In some implementations, the method includes, in accordance with a determination that the movement of the gaze in the first direction and the movement of the head in the second direction are corresponding opposing movements, modifying a display characteristic of the virtual content.