Merged Reality Spatial Streaming for Synchronized Virtual Replicas
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual replicas in virtual worlds lack comprehensive real-world data and synchronization with their counterparts, limiting realism and interaction capabilities.
Innovation Solution
A spatial streaming merged reality system that enriches and synchronizes virtual replicas with real-world data using a server to overlap and stream real-world data onto virtual replicas, classifying and mixing onsite and remote spatial data based on user preferences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If virtual replicas are created without comprehensive real-world data, then device complexity is reduced, but realism and interaction capabilities deteriorate
Solution Approach 1:
The system creates virtual replicas by copying real-world elements and their associated data. Sensors in the real world capture data from elements, which is then transmitted to create corresponding virtual replicas that accurately represent the real-world counterparts, thereby improving realism without manually creating complex virtual models
Solution Approach 2:
A server acts as an intermediary between the real world and virtual world. The server receives sensor data from the real world, processes it, and transmits it to create or update virtual replicas. This intermediary handles the complexity of data integration and synchronization, reducing the complexity burden on individual devices while maintaining high realism
2Loss of information
If virtual replicas are not synchronized with real-world counterparts, then loss of information is reduced, but realism and interaction capabilities deteriorate
Solution Approach 1:
The system maintains continuous synchronization between virtual replicas and real-world elements through ongoing data transmission. Sensors continuously monitor real-world elements and transmit updates to the server, which keeps virtual replicas synchronized in real-time, ensuring continuous realism without periodic large data transfers
Solution Approach 2:
Virtual replicas automatically update themselves by receiving data from the server based on real-world sensor inputs. The system self-maintains synchronization without requiring manual intervention or complex coordination protocols, reducing information loss while maintaining realism
3Reliability
If comprehensive real-world data is transmitted to virtual replicas, then realism is improved, but use of energy and data transmission requirements worsen
Solution Approach 1:
The system transmits only the specific data relevant to each virtual replica rather than comprehensive data for all elements. Sensors capture localized data from specific real-world elements, and the server transmits only the corresponding subset of data needed for that particular virtual replica, reducing energy consumption while maintaining realism
Solution Approach 2:
The system transmits partial data sets that are sufficient for maintaining realism rather than complete comprehensive data. By sending only the essential sensor data needed for accurate representation, the system achieves adequate realism with reduced energy expenditure compared to transmitting all possible data
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
A merged reality system comprises at least one server storing a virtual world system comprising one or more virtual objects, the virtual objects including virtual replicas of at least a first location, a second location, and real world elements in the at least first and second locations. The at least one server is configured to receive, from a plurality of connected devices communicating with the at least one server through a network, real-world data from real-world elements in the first and second locations; use the real-world data from the first and second locations in the virtual world system to enrich and synchronize the virtual replicas with corresponding real-world elements; and overlap and stream at least one portion of the real-world data from the second location onto, e.g., one or more surfaces of the virtual replica of the first location.