Adaptive User Avatars and Audio Mixing for Collocated Sessions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to dynamically adjust visual representations and audio experiences in multi-user communication sessions based on users transitioning between collocated and non-collocated states, leading to suboptimal user interaction and experience.

Innovation Solution

Systems and methods that change the visual appearance and audio properties of users in response to detecting transitions between collocated and non-collocated states, utilizing sensors to capture and analyze environmental overlap and metadata, and adjust audio levels based on distance changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the system maintains static visual representations and audio properties for all users, then the system complexity is reduced, but user interaction quality and immersion deteriorate

Engineering Contradiction:
Improveuser interaction qualityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system dynamically adjusts visual representations and audio properties based on real-time detection of user collocation states. When users are detected as collocated (physically near each other), their visual representations and audio mixing are adjusted differently than when non-collocated, creating an adaptive experience that responds to physical proximity without requiring complex manual configuration

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system automatically detects user collocation states using sensors and metadata, then self-adjusts visual and audio parameters without user intervention. The collocation detection system monitors device proximity and automatically triggers appropriate visual representation modes and audio mixing strategies, eliminating the need for users to manually configure these settings

Inventive Principle:
Principle #25Self-service

2Ease of operation

If the system provides uniform audio output for all users, then device complexity is reduced, but audio experience quality and immersion deteriorate

Engineering Contradiction:
Improveaudio experience qualityVSAvoidaudio processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The audio system applies different mixing strategies to different users based on their collocation state. When users are collocated, their audio is mixed differently than when non-collocated, creating localized audio experiences tailored to each user's physical context rather than applying a uniform audio output to all participants

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes audio parameters (such as volume levels, spatial positioning, and mixing ratios) based on detected user collocation states. When users are physically near each other, the audio parameters are adjusted to reflect this proximity, creating a more immersive and context-appropriate audio experience

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If the system uses simple visual representations for all users, then device complexity is reduced, but user engagement and immersion deteriorate

Engineering Contradiction:
Improveuser engagementVSAvoidvisual processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The visual representation system dynamically changes the mode of display based on detected user collocation states. When users are collocated, their visual representations are adjusted differently than when non-collocated, creating an engaging experience that reflects physical proximity without requiring complex manual configuration

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20260010335A1Visual representations of users in multi-user communication sessions and audio experiences in multi-user communication sessions
Publication Date: 2026.01.08 APPLE INC
  • US20260010335A1 patent drawing
  • US20260010335A1 patent drawing
  • US20260010335A1 patent drawing

AI summary

This includes example systems and methods for changing a visual appearance of a user in a multi-user communication session in response to detecting that the user transitions from being a non-collocated user (e.g., a remote user) within the multi-user communication session to being a collocated user within the multi-user communication session and/or vice versa. This also includes example systems and methods for determining a mode of visual representation of a user of an electronic device that is joined into a multi-user communication session that is already active between users of other electronic devices. This also includes example systems and methods for enhancing audio experiences of collocated users of electronic devices in a multi-user communication session.