VR Headset Physical Object Detection via Wavelength Pattern Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality (VR) systems disrupt the user experience by requiring users to remove their headsets to interact with the physical environment, and current solutions like external cameras or QR code stickers are either visually distracting or costly.
Innovation Solution
The use of wavelength emitting devices, such as LEDs, on physical objects to create unique patterns that are detected by the VR headset's imaging devices, allowing for the overlay of virtual representations of these objects within the VR environment without the need to remove the headset.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users remove the VR headset to interact with the physical environment, then they can see and interact with physical objects, but the immersive VR experience is disrupted and user convenience deteriorates
Solution Approach 1:
The patent uses camera images of the physical environment as an intermediary to bridge the VR and physical worlds. The camera captures real-world objects and displays them within the VR environment, allowing users to interact with physical objects without removing the headset. This mediator enables simultaneous engagement with both virtual and physical environments.
Solution Approach 2:
The patent merges the physical environment representation with the virtual environment by displaying camera-captured images within the VR display. This combination allows users to see both virtual content and physical objects simultaneously, eliminating the need to remove the headset for physical interaction.
2Ease of operation
If external cameras are used to enable physical environment interaction, then users can see physical objects in VR, but visual clutter and noise in the image overlay the experience
Solution Approach 1:
The patent extracts only the essential information from the physical environment by detecting specific patterns (QR codes or unique visual features) rather than displaying the entire camera feed. This extraction approach removes unnecessary visual clutter while retaining critical physical object information needed for interaction.
Solution Approach 2:
The patent applies local quality by selectively enhancing specific regions or objects in the physical environment that contain identifiable patterns. Instead of uniformly processing the entire camera view, the system focuses computational resources on detecting and rendering only the relevant objects with distinct visual characteristics.
3Measurement precision
If QR code stickers with infrared sources are used for object detection, then physical objects can be identified in the VR environment, but the cost of the system increases
Solution Approach 1:
The patent offers a cost-reduced implementation by using standard visual patterns that can be printed or displayed without expensive infrared components. This approach uses readily available cameras and simple graphical patterns instead of costly infrared LEDs and specialized sensors, making the system more accessible.
Solution Approach 2:
The patent uses visual copies or representations of objects through camera images rather than requiring physical modification of objects with expensive infrared components. The system creates a visual replica of the physical environment that can be processed by standard imaging devices.
4Measurement precision
If QR code stickers are placed on physical objects, then object identification is enabled, but the objects must have exposed locations viewable by the camera
Solution Approach 1:
The patent enhances adaptability by supporting multiple detection approaches - both pattern recognition (QR codes) and unique visual feature detection. This multi-functionality allows the system to work with objects that have exposed surfaces for stickers as well as objects that rely on inherent visual characteristics, expanding the range of detectable objects.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless interaction with physical objects within the VR environment by providing a virtual user interface that maintains the immersive experience, allowing users to interact with or avoid physical objects without visual clutter or the need to remove the headset.
Implementation Method 1
In addition to the above, in another example, the at least one imaging device is an infrared camera and the wavelength emitting devices are infrared LEDs.
Implementation Method 2
the wavelength emitting devices are infrared LEDs
Data Source
AI summary
A virtual reality headset including a display to display a virtual environment, an imaging device to capture images of a physical environment surrounding the headset, and a controller to detect patterns of wavelength emitting devices in the captured images and to compare detected patterns to a library of known patterns, each known pattern corresponding to a physical object. When a detected corresponds to a known pattern, the controller to determine a position of the detected pattern in the physical environment relative to the headset, and to display in the virtual environment a virtual representation of the physical object corresponding to the known pattern at a position corresponding to the determined position of the detected pattern in the physical environment relative to the headset.