Dynamic 3D Alert Positioning for XR Interaction Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computer systems for virtual, augmented, and extended reality experiences have cumbersome, inefficient, and limited methods and interfaces for interacting with virtual/augmented/extended reality environments, leading to a significant cognitive burden on users and inefficient energy usage.

Innovation Solution

The system improves user interaction by displaying alerts and notifications in a three-dimensional environment, dynamically changing their position based on the user's viewpoint, and providing different states of alerts that change in response to user attention, thereby reducing the number and complexity of user inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If alerts are displayed at fixed positions in the three-dimensional environment, then the system structure is simple, but the user must continuously scan the environment to notice alerts, increasing cognitive burden and interaction time

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidalert display system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The alert display system transitions from static fixed-position alerts to dynamic alerts that automatically reposition based on user viewpoint. The alert position is continuously updated to maintain spatial relationship with the user, making the system adaptive rather than fixed, thereby reducing cognitive burden without excessive complexity

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The alert system serves itself by automatically tracking and repositioning alerts based on detected user viewpoint changes. The system monitors user position and autonomously adjusts alert locations without requiring user intervention, reducing interaction steps while maintaining manageable system complexity through automated behaviors

Inventive Principle:
Principle #25Self-service

2Loss of information

If the system provides detailed feedback for all user inputs, then user understanding is improved, but the amount of information presented increases cognitive burden

Engineering Contradiction:
Improvefeedback information completenessVSAvoidcognitive burden
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The feedback system applies different levels of detail to different alert types based on their importance and context. Critical alerts receive prominent, detailed presentation while less important notifications receive simpler feedback, optimizing information delivery without overwhelming the user with uniform detailed feedback for all inputs

Inventive Principle:
Principle #3Local quality

3Measurement precision

If multiple input steps are required to achieve a desired outcome, then input precision is improved, but interaction time and energy consumption increase

Engineering Contradiction:
Improveinput accuracyVSAvoidinteraction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically detecting user intent through viewpoint tracking and proactively presenting relevant alerts before the user would need to search for them. This anticipatory behavior reduces the number of interaction steps required while maintaining input accuracy through contextual awareness

Inventive Principle:
Principle #10Preliminary action

4Object-affected harmful factors

If alerts are always displayed with high visibility, then alert noticeability is improved, but energy consumption increases due to continuous high-power display operation

Engineering Contradiction:
Improvealert noticeabilityVSAvoiddisplay energy consumption
Core Design Contradiction:
Object-affected harmful factorsVSUse of energy by moving object

Solution Approach 1:

The display system dynamically adjusts alert visibility characteristics based on user attention state and alert priority. High-priority alerts maintain high visibility while lower-priority alerts use reduced display power, optimizing the balance between noticeability and energy consumption through adaptive rather than constant high-power operation

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250053225A1Devices, Methods, And Graphical User Interfaces for Interacting with Three-Dimensional Environments
Publication Date: 2025.02.13 APPLE INC
  • US20250053225A1 patent drawing
  • US20250053225A1 patent drawing
  • US20250053225A1 patent drawing

AI summary

A computer system, while displaying a first view of a three-dimensional environment that corresponds to a first viewpoint of a user, displays a first user interface object at a first position in the three-dimensional environment that has a first spatial relationship with the first viewpoint of the user. While displaying the first view of the three-dimensional environment including the first user interface object at the first position in the three-dimensional environment, the computer system, in response to detecting a first input that is directed to at least a first portion of the first user interface object, displays a second user interface object at a second position in the three-dimensional environment and moves the first user interface object from the first position to a third position in the three-dimensional environment that has a greater distance from the first viewpoint of the user than the first position in the three-dimensional environment.