Mixed Reality Content Sharing with Viewpoint-Synchronized Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to efficiently share virtual content in mixed reality scenes among multiple users with different viewing positions and orientations, lacking effective methods for content selection, transmission, and rendering on diverse devices.
Innovation Solution
A method for selecting and sharing personalized virtual content between multiple user devices, involving content and device selection, notification, and synchronized rendering, using direct or server-mediated communication, with features like head and eye tracking, and 3D projections for precise content sharing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual content is shared among multiple users with different viewing positions and orientations, then collaborative mixed reality experiences are enhanced, but rendering accuracy and synchronization become difficult to maintain
Solution Approach 1:
The system adapts the rendering of virtual content based on each user's specific viewing position and orientation. Each user device receives customized rendering parameters that optimize the virtual content display for their individual viewpoint, maintaining rendering accuracy while supporting multiple users with different perspectives in the shared mixed reality scene.
Solution Approach 2:
The system dynamically adjusts rendering parameters and content synchronization based on real-time user positions and orientations. As users move or change their viewing angles, the system continuously updates the virtual content rendering to maintain accuracy and synchronization across all devices, enabling flexible collaborative experiences without sacrificing precision.
2Ease of operation
If personalized virtual content is selected and shared between multiple devices, then content relevance to each user is improved, but system complexity increases
Solution Approach 1:
The system performs preliminary actions by pre-processing and organizing virtual content based on user profiles and device characteristics before sharing. Content is pre-adapted and tagged for different user contexts, reducing the complexity of real-time personalization while maintaining high content relevance for each user device in the collaborative session.
3Speed
If virtual content is shared in real-time across multiple devices with different viewing positions, then collaborative interaction is enhanced, but data transmission and synchronization requirements increase
Solution Approach 1:
The system segments the virtual content and synchronization data into user-specific portions based on viewing positions and orientations. Instead of transmitting complete scene data to all devices, only relevant segments are sent to each user device, reducing overall data transmission requirements while maintaining real-time collaborative interaction speed across multiple users.
Data Source
Figure 1
Figure 2
Figure 3A~3C
AI summary
A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described.At a first user device,a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared.The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.