Adaptive User Representation in Collocated Communication Sessions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-user communication systems fail to adapt visual and audio representations of users based on their transition from non-collocated to collocated status, leading to suboptimal user experiences.

Innovation Solution

Systems and methods that dynamically change the visual appearance and audio properties of users in a multi-user communication session based on their collocated or non-collocated status, utilizing sensors to capture and analyze environmental overlap and audio data to adjust representations and audio levels accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the system uses fixed visual and audio representations for all users regardless of location, then the system complexity is reduced, but the user experience quality deteriorates

Engineering Contradiction:
Improveadaptability of visual and audio representationsVSAvoidcomplexity of detecting and adjusting user status
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically adjusts visual representations (avatars vs. video feeds) and audio properties (spatial audio vs. standard audio) based on real-time detection of user collocation status. The representation mode changes from static to adaptive, allowing the system to optimize user experience by selecting appropriate representation types based on whether users are in the same physical location or remote

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously monitors user location status through sensor data and camera analysis, detecting transitions between collocated and non-collocated states. This feedback loop enables automatic adjustment of visual and audio representations, creating a closed-loop system that adapts to changing physical conditions without user intervention

Inventive Principle:
Principle #23Feedback

2Ease of operation

If the system transitions users between collocated and non-collocated representation modes, then the user experience is enhanced, but the frequency of mode switching increases causing potential disruption

Engineering Contradiction:
Improvesmoothness of user interactionVSAvoidtime spent in transition states
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary detection of user collocation status using sensor data and environmental analysis before fully transitioning between representation modes. By detecting collocation state in advance, the system can prepare appropriate representation changes and minimize disruption to ongoing communication

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements smooth dynamic transitions between representation modes rather than abrupt switches. Visual and audio representations adapt gradually as users move between collocated and non-collocated states, reducing the perceived disruption and maintaining continuous communication flow

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4676022A1Visual representations of users in multi-user communication sessions and audio experiences in multi-user communication sessions
Publication Date: 2026.01.07 APPLE INC
  • EP4676022A1 patent drawingFigure 1
  • EP4676022A1 patent drawingFigure 2
  • EP4676022A1 patent drawingFigure 3

AI summary

This includes example systems and methods for changing a visual appearance of a user in a multi-user communication session in response to detecting that the user transitions from being a non-collocated user (e.g., a remote user) within the multi-user communication session to being a collocated user within the multi-user communication session and/or vice versa. This also includes example systems and methods for determining a mode of visual representation of a user of an electronic device that is joined into a multi-user communication session that is already active between users of other electronic devices. This also includes example systems and methods for enhancing audio experiences of collocated users of electronic devices in a multi-user communication session.