Selective Tracking for Head-Mounted Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional head-mounted display (HMD) systems for virtual and augmented reality have limited tracking capabilities, as existing tracking devices have restricted fields of view, which can fail to track controllers when they are moved outside this view, limiting the functionality of the controllers.

Innovation Solution

A selective tracking system that uses a combination of magnetic and image tracking systems to determine the position of target objects, switching between them based on tracking errors, such as when the target object is outside the camera's field of view or if the image tracking information is inaccurate, ensuring continuous tracking by utilizing magnetic field generators and sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional tracking devices with limited field of view are used to track controllers, then the tracking system is simpler and cheaper, but the tracking reliability deteriorates when controllers are moved outside the field of view

Engineering Contradiction:
Improvetracking reliabilityVSAvoidtracking system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple tracking devices with different tracking methods (e.g., optical tracking and magnetic field tracking) into a unified tracking system. The system integrates data from both tracking devices and uses a selection mechanism to choose the most reliable tracking information, thereby improving overall tracking reliability while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If a single tracking device is used, then the device complexity is reduced, but the tracking precision deteriorates when the target is outside the effective tracking area

Engineering Contradiction:
Improveposition determination precisionVSAvoidtracking system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The tracking system is designed to perform multiple tracking functions using different tracking devices. Each tracking device specializes in certain areas (e.g., optical tracking for close-range precision, magnetic field tracking for wide-area coverage), and the system universally supports both tracking methods to maintain position determination precision across various spatial conditions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If multiple tracking devices are used to ensure continuous tracking, then the tracking reliability is improved, but the device complexity and cost increase

Engineering Contradiction:
Improvetracking continuityVSAvoidnumber of tracking devices
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The tracking system dynamically selects which tracking device to use based on real-time conditions. The selection mechanism evaluates the effectiveness of each tracking device (e.g., whether the target is within the field of view, signal quality) and switches between tracking devices as needed, thereby ensuring tracking continuity while avoiding the need to permanently activate all tracking devices, thus managing system complexity.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for uninterrupted tracking of controllers in a wider area, enhancing the functionality and usability of HMD systems by maintaining accurate position determination even when controllers are moved beyond the camera's field of view, thereby improving user interaction in VR and AR environments.

Implementation Method 1

the magnetic sensor assembly includes one or more magnetic sensors that detect strength and direction of the magnetic field

Methodology Applied
Scientific EffectMagnetic field: Magnetic Field

Data Source

PatentEP3721284B1Selective tracking of a head-mounted display
Publication Date: 2023.05.03 META PLATFORMS TECHNOLOGIES LLC
  • EP3721284B1 patent drawingFigure 1
  • EP3721284B1 patent drawingFigure 2
  • EP3721284B1 patent drawingFigure 3

AI summary

A tracking system tracks a target object separated from a head-mounted display (HMD). The tracking system includes a first tracking device (e.g., a camera), a second tracking device (e.g., magnetic tracking system), and a selective tracking system. The first tracking device determines a position of the target object using the first type of tracking information, and determines a tracking error that is associated with the determined position. The selective tracking system compares the tracking error to a threshold value, and based on the comparison, determines a position of the target object using the second tracking device.