Virtual Object Arrangement Updates via Eye Tracking in Live Sessions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing user interfaces for virtual and augmented reality environments are cumbersome, inefficient, and place a significant cognitive burden on users due to complex manipulation of virtual objects, requiring multiple inputs and insufficient feedback, leading to energy waste and suboptimal device performance.

Innovation Solution

The implementation of computer systems with improved user interfaces that facilitate efficient interaction through reduced inputs, enhanced visual feedback, and intelligent response mechanisms, including eye and hand tracking, to update the spatial arrangement of virtual objects in real-time communication sessions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used for virtual and augmented reality environments, then users can interact with virtual objects, but the interaction becomes cumbersome and places significant cognitive burden on users

Engineering Contradiction:

Improveease of interactionVSAvoidcomplexity of manipulation

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically tracks user gaze direction and updates virtual object spatial arrangements without requiring manual input commands. The virtual environment serves itself by interpreting eye movements as control signals, eliminating the need for complex user manipulation procedures.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical input mechanisms (buttons, sliders, keyboard) with biological signal-based control (eye tracking). This substitution eliminates the need for users to physically manipulate controls while maintaining precise control over virtual object positioning.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple inputs are required to achieve desired outcomes in augmented reality environments, then precise control can be achieved, but the number of inputs increases and user efficiency decreases

Engineering Contradiction:

Improveprecision of controlVSAvoidtime for interaction

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system continuously monitors user gaze direction and provides real-time feedback by updating virtual object positions according to eye movements. This closed-loop feedback mechanism maintains precise control while reducing interaction time as the system adapts to user intentions automatically.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system prepares and updates virtual object spatial arrangements in advance based on predicted gaze direction and user intent. By anticipating user needs before explicit commands are given, the system reduces interaction time while maintaining precise control over object positioning.

Inventive Principle:

Principle #10Preliminary action

3Adaptability or versatility

If complex manipulation procedures are used for virtual objects, then detailed control is achieved, but cognitive burden on users increases

Engineering Contradiction:

Improvecontrol capabilityVSAvoidcognitive burden

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The virtual environment automatically interprets eye movements as control commands without requiring users to learn complex manipulation procedures. The system serves itself by translating biological signals into control actions, maintaining detailed control capability while eliminating cognitive burden.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system changes the control parameter from manual input sequences to gaze direction. This parameter transformation maintains versatile control capability over virtual objects while significantly reducing cognitive burden as eye tracking is an intuitive, automatic process.

Inventive Principle:

Principle #35Parameter changes

4Ease of operation

If conventional user interfaces are used, then interaction can be established, but energy consumption increases

Engineering Contradiction:

Improveinteraction efficiencyVSAvoidenergy consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The eye tracking system operates continuously to monitor user gaze and update virtual object positions in real-time. This continuous operation eliminates the need for repeated input cycles, improving interaction efficiency while reducing overall energy consumption compared to conventional intermittent input methods.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS20250232541A1Methods of updating spatial arrangements of a plurality of virtual objects within a real-time communication session

Publication Date: 2025.07.17 APPLE INC

AI summary

In some embodiments, a computer system facilitates the update of a spatial arrangement of one or more virtual objects in a three-dimensional environment from the viewpoint of a first user of the computer system while in a real-time communication session that includes a plurality of users. In some embodiments, updating the spatial arrangement of one or more virtual objects includes collectively moving the one or more virtual objects in the three-dimensional environment relative to the viewpoint of the first user.