Gaze-Based Virtual Object Placement in XR

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for organizing virtual objects in extended reality (XR) environments require significant user effort, particularly large gestures, which can be tiring and inefficient, and do not effectively utilize gaze input for precise object placement.

Innovation Solution

A system that detects user gestures, such as flinging, to associate virtual objects with regions in an XR environment, using gaze input to determine the object placement location based on user focus, thereby reducing the need for extensive user input and allowing for precise placement with minimal effort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional gesture-based methods are used to organize virtual objects, then user control and precision are maintained, but user effort and fatigue increase significantly

Engineering Contradiction:

Improveuser effortVSAvoidobject placement precision

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces gaze input as an intermediary between the user and the virtual object placement system. Instead of directly manipulating objects with large gestures, the user's gaze serves as a mediator that automatically determines the placement location, reducing physical effort while maintaining precision through the natural accuracy of eye movement.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical gesture-based control system with a gaze-based control system. By substituting large physical gestures with subtle eye movements and automated gaze tracking, the system reduces the mechanical effort required from users while achieving comparable or superior placement precision through computational methods.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If large gestures are required for object manipulation, then control precision is maintained, but user fatigue and operational efficiency deteriorate

Engineering Contradiction:

Improveoperational efficiencyVSAvoiduser fatigue

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The system performs automatic object placement based on gaze input, allowing the system to serve itself by interpreting user intent through eye movements and autonomously determining placement locations. This eliminates the need for users to perform tiring large gestures, thereby improving operational efficiency while reducing user fatigue.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by pre-determining object placement locations based on gaze tracking before the user commits to a placement action. This preliminary gaze-based positioning reduces the subsequent effort required from the user, improving overall operational efficiency while minimizing fatigue.

Inventive Principle:

Principle #10Preliminary action

3Measurement precision

If gaze input is utilized for object placement, then placement precision and user effort reduction are achieved, but system complexity increases

Engineering Contradiction:

Improveplacement precisionVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent integrates gaze tracking functionality into the existing XR system, making the gaze input mechanism serve multiple purposes including object selection, placement location determination, and interaction confirmation. This multi-functionality approach achieves high placement precision while minimizing the addition of separate specialized components, thereby controlling system complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Use of energy by moving object

If traditional gesture-based object organization is used, then system simplicity is maintained, but user input requirements and energy consumption increase

Engineering Contradiction:

Improvebattery consumptionVSAvoidinput processing complexity

Core Design Contradiction:

Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent replaces energy-intensive mechanical gesture input with low-power gaze-based input. By substituting large physical movements that require continuous sensor activation and processing with subtle eye movement tracking, the system significantly reduces battery consumption while managing input processing complexity through optimized gaze algorithms.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20230333644A1Arranging Virtual Objects

Publication Date: 2023.10.19 APPLE INC

AI summary

Various implementations disclosed herein include devices, systems, and methods for organizing virtual objects within an environment. In some implementations, a method includes obtaining a user input corresponding to a command to associate a virtual object with a region of an environment. A gaze input corresponding to a user focus location in the region is detected. A movement of the virtual object to an object placement location proximate the user focus location is displayed.