3D User Interface Navigation via Hand Orientation and Depth

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for navigating user interfaces in augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, requiring extensive inputs and leading to errors and energy waste, particularly in battery-operated devices.

Innovation Solution

Implement methods and interfaces that utilize user inputs such as movement in depth, hand orientation, and air gestures to navigate user interfaces, allowing for intuitive and efficient interaction with three-dimensional environments, including the use of touch-sensitive displays, eye-tracking, and hand-tracking components to enhance user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional methods for navigating user interfaces are used in augmented and virtual reality environments, then users can access system and application interfaces, but the interaction becomes cumbersome and requires extensive inputs

Engineering Contradiction:

Improveease of interface navigationVSAvoidcomplexity of input requirements

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces depth as a new dimension for user input by detecting movement in the depth direction relative to a viewpoint. This allows users to navigate interfaces using natural spatial movements rather than traditional two-dimensional inputs, reducing the complexity of interaction requirements while maintaining full interface accessibility.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces conventional mechanical input devices (keyboards, mice, touch screens) with motion sensing technology that detects user movements in three-dimensional space. This substitution eliminates the need for extensive mechanical inputs and enables more intuitive interaction with virtual interfaces.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If multiple inputs are required to switch between application user interfaces, then interface switching can be controlled precisely, but the process becomes tedious and error-prone

Engineering Contradiction:

Improveaccuracy of interface switchingVSAvoidease of interface switching

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The system detects user movements in advance and proactively presents relevant interface elements or initiates interface transitions before the user completes their intended action. This preliminary detection and response reduces the number of subsequent inputs needed while maintaining precise control over interface navigation.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms that continuously monitor user movements and adjust interface responses in real-time. This feedback loop ensures that interface switching is both precise and responsive, eliminating errors and reducing the cognitive burden on users by adapting to their intentions dynamically.

Inventive Principle:

Principle #23Feedback

3Adaptability or versatility

If extensive inputs are required to invoke system user interfaces, then interface functionality can be accessed, but cognitive burden on the user increases significantly

Engineering Contradiction:

Improveaccessibility of system functionsVSAvoidcognitive burden on user

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system performs self-service by automatically detecting user intentions through motion sensing and initiating appropriate interface transitions or actions without requiring explicit user commands. This autonomous response reduces cognitive burden while maintaining full accessibility to system functions through intuitive spatial interactions.

Inventive Principle:

Principle #25Self-service

4Productivity

If conventional navigation methods are used, then users can access interfaces, but time consumption increases and energy is wasted

Engineering Contradiction:

Improvespeed of interface navigationVSAvoidenergy consumption of computer system

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent enables continuous interface navigation through sustained motion detection, allowing users to move through interfaces smoothly without discrete pauses or repeated inputs. This continuous interaction reduces the total time required for navigation and consequently decreases energy consumption by reducing the duration of active processing.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS20250298470A1Devices, Methods, and Graphical User Interfaces for Navigating User Interfaces within Three-Dimensional Environments

Publication Date: 2025.09.25 APPLE INC

AI summary

While a view of an environment is visible via a display generation component, a computer system detects a first user input. In response to detecting the first user input, if the first user input is performed while a hand of a user is oriented with a palm of the hand facing toward a viewpoint of the user, the computer system performs a system operation that includes displaying, in the environment, multiple representations of applications. In response to detecting the first user input, if the first user input is performed while the hand of the user is oriented with the palm of the hand facing away from the viewpoint of the user, the computer system performs an operation associated with a location in the environment toward which the user's attention is directed.