XR Content Interfaces with Spatial Anchoring and Gesture Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies for interacting with content applications in extended reality (XR) environments lack efficiency and intuitiveness, particularly in three-dimensional computer-generated environments, limiting user experience.

Innovation Solution

The implementation of devices and methods that enable interactions with content applications in XR environments through sensors and display components, allowing for anchored user interfaces, clipboard functionalities, and intuitive input mechanisms such as gaze and hand tracking, enhancing user interaction with content items in a three-dimensional space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional two-dimensional interfaces are used in XR environments, then device complexity is reduced, but ease of operation and user experience deteriorate due to lack of spatial interaction capabilities

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions from traditional two-dimensional interfaces to three-dimensional spatial interfaces in XR environments. Content items are arranged in three-dimensional space and can be manipulated through spatial gestures, providing more intuitive and efficient user interaction while leveraging the immersive capabilities of extended reality devices.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces sensors (cameras, depth sensors, gesture recognition systems) as intermediaries between the user and content items. These sensors capture spatial information and user gestures, translating them into meaningful interactions with three-dimensional content, thereby enhancing ease of operation without requiring direct physical contact with displays.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If three-dimensional spatial interaction is implemented, then ease of operation improves, but device complexity increases due to additional sensors and processing requirements

Engineering Contradiction:
Improvespatial interaction capabilityVSAvoidsensor and processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent designs the XR device with multi-functional sensors that serve multiple purposes. For example, cameras and depth sensors not only enable three-dimensional spatial interaction but also support environment mapping, object recognition, and navigation functions. This multi-functionality reduces the need for dedicated components for each feature, thereby managing device complexity while enhancing spatial interaction capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If content items are anchored in three-dimensional space, then ease of operation improves through intuitive spatial manipulation, but device complexity increases due to anchoring and tracking mechanisms

Engineering Contradiction:
Improvecontent manipulation efficiencyVSAvoidanchoring and tracking system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements automatic anchoring mechanisms that utilize environmental features (surfaces, objects, spatial coordinates) to anchor content items in three-dimensional space. The system automatically detects and locks onto these features, eliminating the need for manual anchoring operations. This self-service approach simplifies content manipulation while managing the complexity of tracking systems through automated environmental understanding.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12373081B2Devices, methods and graphical user interfaces for content applications
Publication Date: 2025.07.29 APPLE INC
  • US12373081B2 patent drawing
  • US12373081B2 patent drawing
  • US12373081B2 patent drawing

AI summary

Devices, methods, and graphical interfaces for content applications displayed in an XR environment provide for an efficient and intuitive user experience. In some embodiments, a content application is displayed in a three-dimensional computer-generated environment. In some embodiments, different viewing modes and user interfaces are available for a content application in a three-dimensional computer-generated environment. In some embodiments, different interactions are available with content items displayed in the XR environment.