HMD Marker Alignment for VR Tracking Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual reality systems, the tracking device struggles to relocate with the map created by the head-mounted display device due to differences in camera capabilities, such as placement angles, making accurate localization challenging.

Innovation Solution

A control method is implemented where a first marker is shown on the HMD device's screen, generated according to its camera's capability, and the tracking device is localized with the HMD map by aligning with this marker, allowing the tracking device to correct for differences in camera angles and positions, facilitating accurate localization and calibration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the tracking device uses its own camera capability to create a map, then the map creation process is simplified, but the localization accuracy deteriorates because the tracking device cannot align with the HMD device's coordinate system

Engineering Contradiction:
Improvemap creation processVSAvoidlocalization accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

A marker is introduced as an intermediary object that both the HMD device and tracking device can detect and align with. The marker serves as a common reference point that bridges the coordinate system difference between the two devices, enabling accurate localization without requiring the tracking device to independently create a map.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the reference parameter from each device's own camera coordinate system to a unified coordinate system based on the HMD device's map. By transforming the tracking device's position and orientation parameters into the HMD device's coordinate system through marker alignment, the system achieves consistent spatial reference across devices with different camera capabilities.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the tracking device relocates itself with the map created by the HMD device, then the localization accuracy improves, but the setup complexity increases due to camera capability differences

Engineering Contradiction:
Improvelocalization accuracyVSAvoidsetup process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The marker acts as a simplified intermediary that eliminates the need for complex coordinate transformation algorithms. Instead of directly comparing camera capabilities and performing mathematical transformations, the system uses the marker as a visual guide that both devices can independently detect and align with, significantly simplifying the setup process.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The tracking device autonomously aligns itself with the marker displayed on the HMD device screen without requiring manual calibration or complex configuration. The system performs self-calibration by having the tracking device detect the marker's position and orientation in the real world and automatically adjust its coordinate system to match the HMD device's map.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If a marker is displayed on the HMD device screen for alignment, then the localization process is simplified, but the system requires additional coordination between devices

Engineering Contradiction:
Improvelocalization processVSAvoiddevice coordination
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The HMD device displays the marker's virtual position on the screen based on the tracking device's real-world position, creating a feedback loop. The user adjusts the tracking device's position until the marker appears at the correct location on the screen, providing visual feedback that guides the alignment process and simplifies operation while managing device coordination through iterative adjustment.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12147613B2Control method, virtual reality system, and non-transitory computer readable storage medium with map of head-mounted device
Publication Date: 2024.11.19 HTC CORP
  • US12147613B2 patent drawing
  • US12147613B2 patent drawing
  • US12147613B2 patent drawing

AI summary

A control method, suitable for a virtual reality system including a head-mounted device (HMD device) and a tracking device, is disclosed. The control method includes the following operations: showing a first marker on a screen of the HMD device, in which the first marker is generated according to a capability of a camera of the HMD device; and localizing the tracking device with an HMD map of the HMD device when the tracking device is aligned with the first marker by the tracking device.