3D Home Menu Positioning for Low-Burden XR Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and inefficient use of computer resources, particularly in battery-operated devices.

Innovation Solution

Implementing improved user interfaces and methods that utilize touch-sensitive displays, eye-tracking, hand-tracking, and tactile output generators to enhance interaction efficiency, including techniques like bi-directional scrolling of icons, adaptive display positioning, and intuitive gestures such as 'pluck' for object manipulation and application launching, while providing continuous visual feedback and automatic rearrangement of objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional user interfaces are used for interacting with virtual reality environments, then basic interaction functionality is provided, but user interaction efficiency is low and cognitive burden is high

Engineering Contradiction:

Improveuser interaction efficiencyVSAvoidcognitive burden

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The system automatically performs actions based on detected user intent without requiring explicit confirmation. When the system detects that a virtual object is being dragged toward a portal, it automatically initiates the transfer action, eliminating the need for users to navigate through multiple menus or confirmations, thereby improving interaction efficiency while reducing cognitive load

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system pre-positions and pre-configures virtual objects and interfaces based on anticipated user needs. Portals are pre-configured with target environment information, and objects are pre-positioned in intuitive locations, allowing users to interact with the environment before full setup is complete, thus improving efficiency without increasing operational complexity

Inventive Principle:

Principle #10Preliminary action

2Productivity

If multiple input steps are required to achieve desired outcomes in extended reality environments, then precise control is achieved, but interaction time increases and energy consumption rises

Engineering Contradiction:

Improveinteraction speedVSAvoidenergy consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The system allows users to skip intermediate interaction steps by detecting intent through continuous tracking. When a user grabs and drags a virtual object toward a portal, the system skips confirmation dialogs, menu selections, and manual transfer steps, directly executing the transfer action. This reduces interaction time and the number of processing cycles required, thereby lowering energy consumption in battery-operated devices

Inventive Principle:

Principle #21Skipping (Rushing through)

Solution Approach 2:

The system uses periodic detection and evaluation of user gestures to determine when to execute actions. Instead of requiring continuous input or multiple discrete steps, the system periodically checks user intent through tracking data and executes actions when predefined gesture patterns are recognized, improving interaction speed while reducing the computational energy required compared to step-by-step processing

Inventive Principle:

Principle #19Periodic action

3Ease of operation

If complex manipulation methods are used for virtual objects, then precise control is achieved, but ease of use deteriorates and error rate increases

Engineering Contradiction:

Improveease of useVSAvoiderror rate

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The system provides continuous visual feedback during object manipulation by displaying indicators that show the current state of interactions. When a user drags an object toward a portal, feedback indicators show the transfer progress and confirmation, allowing users to verify their actions are correct before completion. This simple feedback mechanism increases ease of use while reducing errors by making the system state transparent without requiring complex control procedures

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

Instead of requiring users to learn complex manipulation gestures, the system inverts the approach by interpreting natural, intuitive gestures in unconventional ways. A simple grab-and-drag motion, which users naturally perform, is interpreted as a transfer command when performed near portals, rather than requiring specialized VR gestures. This inversion makes the system easier to use while maintaining reliability by leveraging naturally accurate motor skills

Inventive Principle:

Principle #13The other way round (Inversion)

Data Source

PatentUS12561042B2Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Publication Date: 2026.02.24 APPLE INC

AI summary

A computer system detects an input to invoke a home menu user interface. In response to detecting the input, the computer system displays, via one or more display generation components, the home menu user interface in a three-dimensional environment, including: if a viewpoint of a user in the three-dimensional environment had a first elevation relative to a reference plane in the three-dimensional environment, displaying the home menu user interface at a first height in the three-dimensional environment; and, if the viewpoint of the user in the three-dimensional environment had a second elevation relative to the reference plane in the three-dimensional environment, the second elevation being different from the first elevation, displaying the home menu user interface at a second height in the three-dimensional environment, the second height being different from the first height.