AR Video Feed Synchronization via Scene Modification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In shared reality communication events, the delay and synchronization issues with video feeds can cause distractions as the remote user's video appears out of sync with their real-time view, disrupting the immersive augmented reality experience.
Innovation Solution
The video image of the remote user is modified to remove the video feed from the augmented reality display, replacing it with an icon or a more recent capture, ensuring that the remote user's view is synchronized with their real-time environment, thereby maintaining an immersive experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the remote user's video feed is displayed in the augmented reality view, then the remote user can see the local user's environment, but the video feed appears out of sync with the real-time view causing distractions
Solution Approach 1:
The patent extracts and removes the out-of-sync video feed from the augmented reality display. The scene modification module identifies and removes the remote user's video feed that appears out of sync with their real-time environment, replacing it with a modified version that maintains synchronization with the local user's current view, thereby eliminating distractions while preserving the shared reality experience
Solution Approach 2:
The system implements feedback by continuously monitoring the synchronization status of video feeds in the augmented reality display. The scene modification module detects when a video feed is out of sync with the local user's real-time environment and automatically modifies or removes it, creating a closed-loop system that maintains synchronization accuracy and immersive experience
2Adaptability or versatility
If the video feed is displayed as part of the augmented reality scene, then shared reality communication is enabled, but the video feed creates visual clutter and disruption
Solution Approach 1:
The patent applies local quality by selectively modifying different parts of the augmented reality scene. The scene modification module identifies the specific region containing the out-of-sync video feed and applies modification only to that local area, while leaving the rest of the augmented reality scene unchanged. This allows shared reality communication to be maintained in the modified video feed region while eliminating visual disruption in that specific location
3Speed
If the remote user's video is displayed in real-time, then communication responsiveness is improved, but synchronization delays cause the video to appear out of sync
Solution Approach 1:
The system performs preliminary action by proactively modifying the video feed before it causes synchronization issues. The scene modification module detects potential synchronization problems and pre-modifies the video feed to remove or adjust out-of-sync portions, preventing the disruption from occurring in the first place while maintaining real-time communication responsiveness
Data Source
Figure 1A~1B
Figure 2A
Figure 2B
AI summary
A user device comprises a network interface, a rendering module, and a scene modification module. The network interface is configured to receive a video signal from another device via a network. The rendering module is configured to control display apparatus of the user device to display a virtual element to a user of the user device, the virtual element comprising a video image derived from the video signal. The modification module is configured to generate rendering data for displaying a modified version of the virtual element at the other device. The modified version does not include said video image. The network interface is configured to transmit the rendering data to the other device via the network. Alternatively or in addition, the rendering data can be modified at the other device to the same end.