Transmissive Display Mixed Reality Tool Bridge Architecture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) systems face limitations in creating immersive experiences due to motion sickness, computational burdens, and the inability to effectively share and synchronize virtual content across multiple users, while conventional displays and audio systems struggle to present realistic and interactive 3D environments.
Innovation Solution
The development of mixed reality (MR) systems that utilize transmissive displays and speakers to combine real and virtual environments, allowing users to interact with virtual objects by seeing, hearing, and touching corresponding real objects, and enabling consistent placement of virtual objects across multiple MR systems through persistent coordinate data and tool bridge architectures for seamless collaboration and content sharing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If VR systems present a full 3D virtual environment to replace the user's real environment, then immersion is improved, but motion sickness and disorientation occur due to mismatch between visual field and inner ear sensations
Solution Approach 1:
The patent combines VR and AR technologies to create a mixed reality system that merges virtual and real environments. The transmissive display allows users to see both virtual content and real-world references simultaneously, maintaining immersion while providing visual anchors that prevent motion sickness and disorientation.
2Reliability
If VR systems present a full 3D virtual environment with high realism, then immersion is improved, but computational burden increases significantly
Solution Approach 1:
The system uses partial action by selectively rendering only the necessary virtual content rather than a complete high-fidelity 3D environment. The transmissive display shows virtual objects overlaid on the real world, allowing users to see through virtual content to real-world references, thereby reducing computational requirements while maintaining immersion.
3Device complexity
If conventional displays are used to present virtual environments, then device complexity is reduced, but the ability to create realistic and immersive 3D experiences is limited
Solution Approach 1:
The system changes the optical parameters of the display by using transmissive technology that allows light to pass through virtual content to reach the user's eyes. This parameter change enables the display to show both virtual and real environments simultaneously, achieving realistic 3D experiences without the complexity of fully immersive VR headsets.
4Adaptability or versatility
If multiple users share a physical space, then collaboration potential is improved, but users cannot directly see or interact with each other in virtual environments
Solution Approach 1:
The system uses the real-world environment as an intermediary to enable virtual user interaction. By anchoring virtual content to physical locations and objects that users can see and touch, the system mediates between virtual avatars and physical presence, allowing users to locate and interact with each other through shared physical references.
Data Source
AI summary
Disclosed herein are systems and methods for sharing and synchronizing virtual content. A method may include receiving, from a host application via a wearable device comprising a transmissive display, a first data package comprising first data; identifying virtual content based on the first data; presenting a view of the virtual content via the transmissive display; receiving, via the wearable device, first user input directed at the virtual content; generating second data based on the first data and the first user input; sending, to the host application via the wearable device, a second data package comprising the second data, wherein the host application is configured to execute via one or more processors of a computer system remote to the wearable device and in communication with the wearable device.