AR Headset Avatar Synchronization for Shared Viewing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for remote content viewing fail to replicate the social experience of watching content together, as they lack effective representation of body language and spatial interaction, leading to an unnatural viewing experience.

Innovation Solution

The use of augmented reality (AR) headsets to display virtual representations of users in a real-world environment, synchronizing their positions relative to their screens, allowing for realistic and immersive social interaction during content viewing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If synchronized content playback is implemented, then users can view content together remotely, but social interaction capability deteriorates

Engineering Contradiction:
Improvecontent synchronizationVSAvoidsocial interaction capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system creates virtual copies (avatars) of remote users that replicate their physical presence, body language, and spatial relationships in the local user's environment. These avatars are generated by capturing the remote user's video feed and mapping it to a virtual representation that moves and gestures according to the remote user's actual movements, enabling social interaction without requiring the remote user to be physically present

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system introduces an intermediary layer between the remote user and the local user - a virtual avatar that acts as a mediator. The avatar receives input from the remote user's camera and movements, then presents this information in a form that preserves body language and spatial context for the local user, facilitating natural social interaction while maintaining content synchronization

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If video chat is used to enable social interaction, then users can communicate, but body language and spatial context are lost

Engineering Contradiction:
Improvesocial interaction capabilityVSAvoidbody language and spatial context
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system creates a virtual copy of the remote user's physical presence by mapping their video feed to an avatar that replicates their body movements, gestures, and spatial position. This copy preserves body language information that would otherwise be lost in traditional video chat, allowing local users to observe and respond to subtle non-verbal cues

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system transitions from two-dimensional video screens to three-dimensional virtual representations that occupy physical space in the local user's environment. The avatars are positioned and oriented in 3D space according to the remote user's relative position, restoring spatial context that is flattened and lost in conventional video chat interfaces

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If multiple video feeds are displayed simultaneously, then all users are visible, but user attention is divided

Engineering Contradiction:
Improvevisibility of all usersVSAvoiduser attention management
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Instead of displaying multiple video feeds, the system creates a single integrated virtual environment where all remote users are represented as avatars sharing the local user's physical space. This unified representation allows the local user to naturally shift attention between avatars by turning their head or moving their gaze, eliminating the need to divide attention between multiple separate video windows

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system merges multiple separate video feeds into a single cohesive virtual scene where all avatars coexist in shared physical space. This consolidation transforms the viewing experience from managing multiple discrete video windows to navigating a unified virtual environment, simplifying attention management while maintaining visibility of all participants

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If VR headsets are used for immersive experience, then spatial presence is achieved, but content viewing quality deteriorates

Engineering Contradiction:
Improvespatial presenceVSAvoidcontent viewing quality
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system segments the virtual environment into distinct functional zones: a large virtual screen for high-quality content display and smaller avatar representations for social interaction. This segmentation allows each element to be optimized independently - the screen maintains high resolution for content while avatars provide spatial presence, avoiding the compromise required by full VR headsets

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240257472A1System and method for shared frame-of-reference content streaming
Publication Date: 2024.08.01 ADEIA GUIDES INC
  • US20240257472A1 patent drawing
  • US20240257472A1 patent drawing
  • US20240257472A1 patent drawing

AI summary

Systems and methods for creating a social content-viewing experience are described herein. In one embodiment, users are located in different physical locations. Each user is viewing a screen in a respective physical location. Content displayed on the screens is synchronized by a media system such that each user is viewing the same media asset. A media asset may be a movie, TV show, sports game, photo, presentation, or video game, to name a few examples. At least one user is using an AR headset. The AR headset displays avatars to represent the other users and displays the avatars in the viewing area of the user wearing the AR headset. For the user wearing the AR headset, the avatars provide a viewing experience that simulates having the other users present in the viewing area.