Mixed-Reality Live Communication Interfaces with Adaptive Controls

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interfaces for managing live communication sessions in augmented and mixed reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and inefficient energy usage, particularly in battery-operated devices.

Innovation Solution

Implement improved user interfaces that utilize gaze and gesture detection, spatial and non-spatial communication session transitions, and avatar editing, along with reduced-prominence controls, to enhance interaction efficiency and reduce the number and nature of user inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used for managing live communication sessions, then basic communication functionality is provided, but user input complexity and cognitive burden increase significantly

Engineering Contradiction:
Improveuser input complexityVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The interface is segmented into different states (reduced-prominence state and increased-prominence state) based on user interaction context. Controls are divided into primary and secondary sets, where primary controls are always visible and secondary controls appear only when needed, reducing cognitive load while maintaining functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The user interface dynamically adjusts its appearance based on user inputs and communication session states. Controls transition between reduced-prominence and increased-prominence states, and the interface adapts to different communication modes (spatial vs non-spatial), making the system responsive and adaptive rather than static.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If multiple controls are displayed to provide full functionality, then all communication options are available, but energy consumption increases

Engineering Contradiction:
Improvecommunication optionsVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

Instead of continuously displaying all controls at full prominence, the system uses periodic display - showing controls in reduced-prominence state continuously but only activating full-prominence display when user interaction requires it. This periodic activation of full functionality reduces overall energy consumption while maintaining adaptability.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

Different parts of the interface have different display qualities - primary controls maintain full visibility and functionality, while secondary controls appear only locally where needed based on current interaction context. This localized display of full functionality reduces overall system power consumption.

Inventive Principle:
Principle #3Local quality

3Reliability

If a series of inputs are required to achieve desired outcomes, then precise control is possible, but interaction time and complexity increase

Engineering Contradiction:
Improvecontrol precisionVSAvoidinteraction time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically transitioning controls between prominence states based on detected user inputs and communication session states. This automation reduces the number of manual inputs needed while maintaining precise control over communication session management.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The interface incorporates feedback mechanisms where user inputs are detected and used to automatically adjust control visibility and state. This feedback loop enables more efficient interaction by anticipating user needs and pre-positioning controls, reducing interaction time while maintaining precision.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12417596B2User interfaces for managing live communication sessions
Publication Date: 2025.09.16 APPLE INC
  • US12417596B2 patent drawing
  • US12417596B2 patent drawing
  • US12417596B2 patent drawing

AI summary

The present disclosure generally relates to managing live communication sessions. A computer system optionally displays an option to invite the respective user to join the ongoing communication session. A computer system optionally one or more options to modify an appearance of an avatar representing the user of the computer system. A computer system optionally transitions a communication session from a spatial communication session to a non-spatial communication session. A computer system optionally displays information about a participant in a communication session.