UWB Overlay for Real-World Object Interaction in VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality technologies fail to provide real-time awareness and interaction with real-world objects and events for users immersed in virtual environments, limiting their ability to perform tasks in the real world without exiting the virtual session.
Innovation Solution
An ultra-wideband (UWB) based system that detects real-world objects and events, predicts user actions, and generates an overlay of these objects within the virtual session, allowing users to interact with them virtually and perform actions in the real world without leaving the virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user wears HMD to immerse in virtual session, then the user experience of virtual environment is improved, but the user becomes dissociated from real-world objects and events
Solution Approach 1:
The patent introduces an intermediary system consisting of sensors, processors, and overlay generation modules that mediate between the virtual and real worlds. The system detects real-world objects and events, predicts user actions, and generates overlays within the virtual session to bridge the dissociation gap, allowing users to maintain awareness of both environments simultaneously
Solution Approach 2:
The patent adds a new dimensional layer by generating overlays within the virtual session that represent real-world objects. This creates a three-layer structure: the base virtual environment, the overlay layer representing real objects, and the physical real-world layer, enabling users to perceive and interact with both virtual and real elements without removing the HMD
2Ease of operation
If the user removes HMD or switches to camera mode to interact with real-world objects, then real-world interaction capability is improved, but virtual session continuity is broken and privacy is infringed
Solution Approach 1:
The system performs preliminary detection of real-world objects and prediction of user actions before the user actually interacts with them. By anticipating user needs and pre-generating appropriate overlays, the system enables seamless interaction with real-world objects while maintaining virtual session continuity without requiring HMD removal or camera mode switching
3Reliability
If text notifications are displayed in HMD to warn users about real-world objects, then user safety is improved, but the real-world objects are not replicated in real time and user navigation is not assisted
Solution Approach 1:
Instead of using simple text notifications, the patent creates virtual copies (overlays) of real-world objects within the virtual session. These overlays replicate the appearance and position of real objects, providing rich visual information and enabling intuitive interaction guidance. The overlays are dynamically updated in real-time as users move and interact with objects in the physical world
Solution Approach 2:
The system continuously monitors user position, movement, and interaction patterns, then provides real-time feedback through updated overlays and predicted action indicators. This feedback loop guides users toward real-world objects of interest and adjusts the overlay presentation based on user behavior, making the interaction more intuitive and effective
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless interaction with real-world objects and events while maintaining immersion in the virtual environment, enhancing user experience and productivity by allowing simultaneous participation in both virtual and real-world tasks.
Implementation Method 1
transmitting a first signal in the proximity of the user; receiving a second signal reflected from the at least one real-world object
Implementation Method 2
an ultra-wideband (UWB) based system that detects real-world objects and events
Data Source
AI summary
According to an embodiment of the disclosure, the method may include detecting the at least one real-world object, detecting an occurrence of an event associated with the at least one real-world object in proximity of an user in a real world, predicting at least one user action in the real world subsequent to the occurrence of the event based on a movement of an user in the real world for interacting with the at least one real world object and generating an overlay of the at least one real-world object within the ongoing virtual session based on a position of at least one real world object and a position of the user.