Digital Assistant Placement Outside View in CGR Interfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Interacting with digital assistants within complex computer-generated reality (CGR) environments can be difficult, confusing, or distracting, as the interface may be large and complex, making it challenging to invoke and utilize the assistant without disrupting immersion.

Innovation Solution

Position a digital assistant object outside the user's field of view within the CGR environment and provide an indication of its location, allowing the assistant to be animated into view when needed, reducing the time and inputs required to access functionality and conserving power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the digital assistant interface is made accessible within the CGR environment, then user interaction capability is improved, but interface complexity and distraction from immersion increase

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The digital assistant object is extracted from the main CGR interface and positioned in a separate, dedicated location within the CGR environment. This allows the assistant to be accessible while maintaining interface simplicity and reducing visual clutter in the primary CGR view.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The digital assistant is positioned in a different spatial dimension or plane within the CGR environment, separate from the main interaction area. This dimensional separation allows users to access the assistant without it competing for attention with the primary CGR content.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If the digital assistant is positioned within the current field of view, then accessibility is improved, but distraction from CGR immersion increases

Engineering Contradiction:
ImproveaccessibilityVSAvoiddistraction from immersion
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The digital assistant object is pre-positioned in a designated location within the CGR environment that is outside the current field of view. When users want to interact with the assistant, they naturally move to this predetermined location, providing accessibility without initial distraction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The digital assistant is placed in a specific local region of the CGR environment with distinct visual or spatial characteristics that differentiate it from the main CGR content. This localized positioning allows users to distinguish the assistant's location without it being constantly visible or distracting.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If explicit user inputs are required to access the digital assistant, then interface precision is improved, but power consumption increases

Engineering Contradiction:
Improveinterface precisionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system automatically detects when users intend to access the digital assistant based on their natural movements or gestures toward the assistant's designated location. This self-service approach eliminates the need for explicit activation commands, reducing the number of input operations and associated power consumption while maintaining precise intent detection.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12620179B2Digital assistant object placement
Publication Date: 2026.05.05 APPLE INC
  • US12620179B2 patent drawing
  • US12620179B2 patent drawing
  • US12620179B2 patent drawing

AI summary

Systems and processes for operating an intelligent automated assistant within a computer-generated reality (CGR) environment are provided. For example, a user input invoking a digital assistant session is received, and in response, a digital assistant session is initiated. Initiating the digital assistant session includes positioning a digital assistant object at a first location within the CGR environment but outside of the currently-displayed portion of the CGR environment at a first time, and providing a first output indicating the location of the digital assistant object.