Shared 3D Interface Objects With Visual Lockout Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods and interfaces for interacting with virtual and augmented reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and energy wastage, particularly in battery-operated devices.

Innovation Solution

The system employs improved methods and interfaces that enhance user interaction by providing intuitive feedback, adjusting user interface objects based on user inputs, tracking physical and virtual object movements, and adapting immersion levels based on biometric data, while aggregating sensory adjustments and virtual content to match the user's exercise type and environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used for interacting with virtual reality environments, then basic interaction functionality is provided, but the interface becomes cumbersome and creates significant cognitive burden on users

Engineering Contradiction:
Improveease of interactionVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically detects user inputs and performs operations without requiring explicit commands. The interface monitors user actions (e.g., picking up virtual objects) and autonomously determines when to execute operations, eliminating the need for complex multi-step interaction sequences and reducing cognitive burden on users.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides immediate visual feedback when operations are performed by detecting user inputs. This feedback mechanism helps users understand the connection between their actions and system responses, reducing confusion and making the interface more intuitive without requiring complex interaction protocols.

Inventive Principle:
Principle #23Feedback

2Productivity

If conventional user interfaces require series of inputs to achieve desired outcomes, then basic control is maintained, but interaction time increases and energy is wasted

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidinteraction time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary detection of user inputs and prepares to execute operations automatically. By monitoring user actions in advance and determining operation execution without requiring explicit commands, the system eliminates unnecessary intermediate steps and reduces interaction time while maintaining appropriate control.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If the system provides detailed feedback for all user inputs, then user understanding is improved, but energy consumption increases in battery-operated devices

Engineering Contradiction:
Improvefeedback informationVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system provides feedback selectively rather than for all user inputs. By determining when feedback is necessary based on operation execution context, the system maintains sufficient user understanding while avoiding excessive energy consumption from continuous or unnecessary feedback provision.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP4729140A2Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
Publication Date: 2026.04.22 APPLE INC
  • EP4729140A2 patent drawingFigure 1
  • EP4729140A2 patent drawingFigure 2
  • EP4729140A2 patent drawingFigure 3

AI summary

A computer system displays a first user interface object with a first appearance at a first position in a first view of a three-dimensional environment that is at least partially shared between a first and second user. While displaying the first user interface object, the computer system detects a first user input by the first user. In response to detecting the first user input: in accordance with a determination that the second user is not currently interacting with the first user interface object, the computer system performs a first operation; and in accordance with a determination that the second user is currently interacting with the first user interface object, the computer system displays a visual indication, that the first user interface object is not available for interaction, including changing an appearance or position of the first user interface object, and forgoes performing the first operation.