Visual Marker Tracking for Handheld VR Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented and virtual reality systems face challenges in accurately tracking and interacting with handheld electronic devices within immersive virtual environments, particularly in translating physical movements into corresponding interactions within the virtual space.
Innovation Solution
The implementation of visual markers on head-mounted displays and handheld devices, utilizing image sensors and infrared technology to detect and process patterns, allows for precise 6DOF tracking and interaction, enabling seamless translation of device movements into virtual environment interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visual markers and image sensors are used for tracking, then measurement precision of device position is improved, but device complexity increases
Solution Approach 1:
Visual markers serve as intermediaries between the handheld device and the head-mounted display tracking system. The markers are placed on the handheld device and detected by the HMD's camera, enabling accurate 6DOF tracking without requiring complex sensors in the handheld device. This mediator approach transfers the tracking complexity to the HMD while keeping the handheld device simple.
Solution Approach 2:
The system uses visual copies (markers) of the handheld device that can be detected by the HMD camera. Instead of directly tracking the physical device with complex sensors, the system tracks visual representations (markers) that are easier to detect and process, thereby improving measurement precision while managing system complexity.
2Measurement precision
If 6DOF tracking is implemented, then measurement precision of device movement is improved, but processing workload on HMD increases
Solution Approach 1:
The tracking system segments the 6DOF tracking task into two parts: the HMD captures images of the markers using its camera, and the processing of marker positions to determine 6DOF information is performed by the connected computing device. This segmentation reduces the processing workload on the HMD while maintaining high measurement precision.
Solution Approach 2:
The visual markers act as intermediaries that carry tracking information. The HMD only needs to capture images of these markers, while the complex processing of converting marker positions into 6DOF data is handled by the external computing device, thereby reducing HMD processing workload.
3Ease of operation
If markers are placed on handheld device, then ease of operation is improved, but device complexity increases
Solution Approach 1:
Visual markers serve as intermediaries that enable accurate tracking of the handheld device without adding complex sensors or processors to the device. The markers are simple visual patterns that can be easily attached to the handheld device, improving ease of operation while adding minimal complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides reliable and accurate tracking and interaction within virtual environments, enhancing user experience by allowing precise movement translation and reducing processing workload on the head-mounted display.
Implementation Method 1
utilizing image sensors and infrared technology to detect and process patterns
Data Source
Figure 1
Figure 2A~2B
Figure 3A~3B
AI summary
A system for tracking a first electronic device, such as a handheld smartphone, in a virtual reality environment generated by a second electronic device, such as a head mounted display may include detection, by a camera included in one of the first electronic device or the second electronic device, of at least one visual marker included on the other of the first electronic device or the second electronic device. Features detected within the field of view corresponding to known features of the visual markers may be used to locate and track movement of the first electronic device relative to the second electronic device, so that movement of the second electronic device may be translated into an interaction in a virtual experience generated by the second electronic device.