VR Hand Controller Pose Tracking via HMD Diffuse Light Lookup

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual reality (VR) systems require external systems with fixed transmitters and high-bandwidth sensors to track the position and orientation of hand controllers, which are costly, space-intensive, and sensitive to optical noise.

Innovation Solution

The VR system uses diffuse electromagnetic radiation from LEDs in a head-mounted display (HMD) detected by photodiodes in the hand controller, comparing the patterns to a lookup table to determine position and orientation with sub-millimeter accuracy, eliminating the need for external transmitters and high-bandwidth sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If external fixed transmitters and high-bandwidth sensors are used to track hand controller position and orientation, then tracking accuracy is improved, but system cost and device complexity increase

Engineering Contradiction:
Improvetracking accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a simplified optical copying approach where LEDs in the HMD create virtual optical markers that the hand controller's photodiodes detect. Instead of complex external transmitters and sensors, the system copies the essential tracking function using diffuse light patterns from standard LEDs, achieving accurate position and orientation detection through pattern recognition rather than high-bandwidth sensor data

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent extracts the tracking function from the external system and relocates it to the HMD itself. By placing LEDs in the HMD and photodiodes in the hand controller, the system eliminates the need for external fixed transmitters and high-bandwidth sensors, achieving tracking using only the diffuse light already present in the virtual reality environment

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If external fixed transmitters are used for tracking, then tracking reliability is improved, but space requirements and installation complexity increase

Engineering Contradiction:
Improvetracking reliabilityVSAvoidspace requirements
Core Design Contradiction:
ReliabilityVSArea of stationary object

Solution Approach 1:

The patent merges the transmitter function into the HMD that the user already wears. The LEDs in the HMD serve dual purposes: providing visual output for the virtual reality experience and serving as optical markers for tracking the hand controller. This eliminates the need for separate external transmitter infrastructure and reduces space requirements to just the wearable HMD volume

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The HMD serves itself by providing the optical markers needed for tracking. Instead of requiring external systems to illuminate the scene, the HMD's own display elements (LEDs) create the optical patterns that enable the hand controller to determine its position and orientation, making the system self-sufficient and eliminating installation complexity

Inventive Principle:
Principle #25Self-service

3Measurement precision

If high-bandwidth sensors are used to detect transmitter signals, then measurement precision is improved, but sensitivity to optical noise increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidoptical noise sensitivity
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent uses periodic pulsing of the LEDs in the HMD to create time-synchronized optical markers. The hand controller's photodiodes detect these periodic light pulses and use timing information to distinguish the structured light patterns from ambient optical noise, achieving accurate tracking without requiring high-bandwidth sensors that would be sensitive to noise

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent utilizes different wavelengths (colors) of light from multiple LEDs to create distinctive optical patterns. The photodiodes in the hand controller detect these color-coded light patterns and use wavelength discrimination to filter out ambient optical noise, maintaining measurement precision without requiring high-bandwidth sensors

Inventive Principle:
Principle #32Color changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach simplifies and reduces costs while maintaining accuracy in tracking the hand controller's position and orientation, reducing sensitivity to external light and eliminating the need for large spaces.

Implementation Method 1

The method can include receiving, by processing circuitry, a pulse of diffuse electromagnetic radiation from a plurality of radiation transmitters placed in the HMD. The method can also include generating, by the processing circuitry, a digital signal from the diffuse electromagnetic radiation.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10444865B2Tracking of position and orientation of objects in virtual reality systems
Publication Date: 2019.10.15 GOOGLE LLC
  • US10444865B2 patent drawing
  • US10444865B2 patent drawing
  • US10444865B2 patent drawing

AI summary

Techniques of tracking a hand controller in a VR system involves detecting, by photodiodes in the hand controller, patterns of diffuse radiation generated by diffuse LEDs in the HMD. Such techniques can also include comparing the detected patterns to those simulated offline previously and represented in a lookup table (LUT). By looking up the detected patterns in the LUT, the VR system may determine the position and/or orientation of the hand controller with sub-millimeter accuracy. Some advantages of the improved techniques can be in the simplicity and/or low cost of the components without sacrificing accuracy in deriving the position and orientation of the hand controller.