Hybrid Reality Environment Server for Real-Time Multi-User Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality applications do not enable users to interact with real objects in a hybrid reality environment where both real and virtual objects co-exist and interact in real time.
Innovation Solution
A method and apparatus that generate a hybrid reality environment by receiving data from multiple users, including 3D data and real-time video and audio, to create scenes where users can interact with virtual objects in real time, using a server device with processors and memory to manage the interaction between real and virtual objects across different physical locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional AR applications are used, then users can view virtual objects in a virtualized environment, but users cannot interact with real objects in real time
Solution Approach 1:
The patent merges conventional AR virtualized environment with real-world video feeds to create a hybrid reality environment. The server combines virtual object rendering with real-time video streams from multiple users, allowing participants to interact with both virtual objects and real objects simultaneously in a unified interface.
Solution Approach 2:
The server acts as an intermediary that receives video streams from multiple users, renders virtual objects, and combines them into a unified hybrid reality scene. This mediator coordinates between real-world inputs and virtual object generation, managing the complexity of real-time interactions.
2Ease of operation
If real-time interaction between multiple users at different locations is enabled, then hybrid reality environment is achieved, but data processing and synchronization complexity increases
Solution Approach 1:
The server serves as a central intermediary that receives video streams, user inputs, and virtual object data from multiple participants at different locations. It synchronizes all these elements in real-time and distributes the combined hybrid reality scene back to each user, managing the complexity of multi-location coordination.
Solution Approach 2:
The system implements real-time feedback loops where user interactions with the hybrid reality environment are immediately processed and reflected in the scene. Video streams, virtual object positions, and user actions continuously update each other in real-time, enabling seamless interaction despite distributed locations.
3Adaptability or versatility
If virtual objects are generated based on real-time user data, then interactivity is enhanced, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-rendering virtual objects and preparing scene elements before they are needed in the hybrid reality environment. The server pre-processes video streams and prepares virtual object data structures, reducing the computational burden during real-time interaction moments.
Solution Approach 2:
The system maintains continuous processing of video streams and virtual object generation without interruption. Rather than batch-processing, the server continuously updates the hybrid reality scene in real-time, ensuring that virtual objects remain synchronized with user actions and environmental changes without processing delays.
Data Source
AI summary
A method for generating a hybrid reality environment includes receiving data of a first user and a second user at different locations. The method also includes generating a scene of an augmented reality (AR) based environment that includes the first user and a virtual object related to the second user; and generating a scene of an augmented virtuality (AV) based environment that includes the virtual object related to the second user and a virtual object related to the first user. The method further includes sending signals for displaying the scene of the AR based environment to the first user and displaying the scene of the AV based environment to the second user such that the first user can interact with the virtual object related to the second user in real time and the second user can interact with the virtual object related to the first user in real time.