Live Communication UI States for Gaze-Based AR Session Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interfaces for managing live communication sessions in augmented and mixed reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and inefficient energy usage, particularly in battery-operated devices.

Innovation Solution

Implementing computer systems with improved interfaces that utilize gaze and gesture detection, spatial and non-spatial communication session transitions, and avatar editing, along with reduced-control display prominence, to enhance user interaction efficiency and reduce input requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used for managing live communication sessions, then basic communication functionality is provided, but the interfaces become cumbersome and complex, creating significant cognitive burden on users

Engineering Contradiction:
Improveuser interface simplicityVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The interface is segmented into different states (first state with first controls, second state with second controls) that are displayed based on communication session conditions. This allows the system to present only relevant controls for the current situation, reducing perceived complexity while maintaining full functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The user interface dynamically transitions between different control sets based on whether a communication session is active. The system automatically adjusts the interface state to match the communication context, making the interface adaptive and context-aware rather than static and overly complex.

Inventive Principle:
Principle #15Dynamics

2Productivity

If multiple inputs are required to achieve desired outcomes in augmented reality environments, then precise control is achieved, but the number of inputs increases and energy consumption rises

Engineering Contradiction:
Improveinput efficiencyVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system automatically determines when to display different control sets based on the communication session state, eliminating the need for users to manually trigger interface changes. This automatic adaptation reduces the number of inputs required while maintaining precise control over communication functions.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If detailed controls are always displayed for virtual objects, then user control precision is maintained, but the cognitive burden and time required for interaction increases

Engineering Contradiction:
Improvecontrol accessibilityVSAvoidinteraction time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system prepares and displays appropriate controls in advance based on the current communication state, so that when a user needs to perform an action, the necessary controls are already visible and accessible. This eliminates the need for users to navigate through multiple interface states to find the required controls.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250342671A1User interfaces for managing live communication sessions
Publication Date: 2025.11.06 APPLE INC
  • US20250342671A1 patent drawing
  • US20250342671A1 patent drawing
  • US20250342671A1 patent drawing

AI summary

The present disclosure generally relates to managing live communication sessions. A computer system optionally displays an option to invite the respective user to join the ongoing communication session. A computer system optionally displays one or more options to modify an appearance of an avatar representing the user of the computer system. A computer system optionally transitions a communication session from a spatial communication session to a non-spatial communication session. A computer system optionally displays information about a participant in a communication session.