VR Object Detection via Headset and Tracker Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users wearing head-mounted display devices in virtual reality systems face inconvenience in locating physical objects without removing the device, as they struggle to determine their orientation and position in space.
Innovation Solution
A virtual reality system incorporating a head-mounted display with cameras and a processor, along with a tracker, uses an object detector to capture and process frames from both devices, allowing the system to indicate the position of physical objects within the environment, enabling users to find objects without removing the headset.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a user wears a head-mounted display device to experience virtual reality, then the user can immerse in the virtual environment, but the user cannot distinguish his/her orientation or physical position in space and cannot find physical objects without taking off the device
Solution Approach 1:
The patent introduces an object detector as an intermediary system that bridges the virtual reality environment and the physical world. The object detector processes images captured by cameras, identifies physical objects and their locations, and provides this information to the user through the head-mounted display without requiring the user to remove the device. This mediator enables the user to locate physical objects while maintaining immersion in the virtual environment.
2Ease of operation
If the user takes off the head-mounted display device to search for physical objects, then the user can locate objects, but the virtual reality experience is interrupted
Solution Approach 1:
The system performs preliminary action by continuously capturing images of the physical environment through cameras and pre-processing these images to identify physical objects and their locations before the user needs to search for them. The object detector maintains an updated understanding of the physical environment, so when the user needs to locate an object, the information is already prepared and can be immediately presented through the head-mounted display, preventing interruption of the virtual reality experience.
3Ease of operation
If multiple cameras and processing components are added to enable object detection, then object location capability is improved, but device complexity increases
Solution Approach 1:
The head-mounted display device is enhanced with multi-functionality by integrating object detection capabilities into the existing virtual reality system. The same processing unit that handles virtual reality rendering also processes images for object detection, and the display system presents both virtual reality content and object location information. This universal approach allows one system to serve multiple purposes, reducing the need for separate dedicated components and minimizing overall device complexity.
Data Source
AI summary
An object detection method is suitable for a virtual reality system. The object detection method includes a plurality of first cameras of a head-mounted display (HMD) to capture a plurality of first frames. A plurality of second frames are captured through a plurality of second cameras in a tracker, wherein, the object detector searches for the object position in the first frames and the second frames.