Hand-Held Controller 3D Position Tracking via Beacon and IMU Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional human interface devices are limited to two-dimensional control, which restricts user precision and accuracy when interacting with three-dimensional software applications in fields like engineering, graphic design, and gaming.

Innovation Solution

A system comprising a hand-held controller and a positional reference device that uses a beacon sensing device and inertial measurement units to determine the controller's position and orientation within a three-dimensional space, enabling precise three-dimensional control through the combination of optical and inertial data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional human interface devices are used, then device simplicity is maintained, but user precision and accuracy in three-dimensional control deteriorates

Engineering Contradiction:
Improveuser precision and accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges optical tracking (beacon sensing device capturing images of positional reference) with inertial measurement (IMU sensors in hand-held controller) to achieve precise three-dimensional control. This combination of multiple sensing modalities resolves the contradiction by providing high measurement precision through integrated data processing while maintaining relatively simple individual device components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The beacon sensing device and positional reference device act as intermediaries between the user and the three-dimensional software environment. These intermediary devices capture spatial information and transmit it to the system, enabling precise control without requiring complex direct manipulation interfaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If two-dimensional control interfaces are used, then ease of operation is maintained, but control precision in three-dimensional environments deteriorates

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system transitions from two-dimensional control interfaces to three-dimensional control by tracking the spatial position and orientation of the hand-held controller in three-dimensional space. The beacon sensing device captures the positional reference from multiple dimensions, and the system processes this spatial data to provide intuitive three-dimensional control that naturally extends familiar two-dimensional interaction patterns.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If optical and inertial sensing systems are integrated, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvepositional and orientational data accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements feedback processing where the beacon sensing device continuously captures the positional reference, the IMU sensors provide inertial measurement data, and the system processes this combined information to compute accurate position and orientation. This feedback loop maintains high measurement precision while managing system complexity through coordinated data processing from multiple sensors.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for precise three-dimensional control, enhancing user interaction with software applications by providing accurate positional and orientational data, thereby improving precision and accuracy in three-dimensional environments.

Implementation Method 1

a beacon sensing device for optically capturing an image of the positional reference

Methodology Applied
Scientific EffectOptical imaging: Photography

Implementation Method 2

inertial measurement information from inertial measurement units within the hand-held controller

Methodology Applied
Scientific EffectInertial measurement: Accelerometer

Data Source

PatentUS11579711B2Three-dimensional object position tracking system
Publication Date: 2023.02.14 MARBL LTD
  • US11579711B2 patent drawing
  • US11579711B2 patent drawing
  • US11579711B2 patent drawing

AI summary

A hand-held controller and a positional reference device for determining the position and orientation of the hand-held controller within a three-dimensional volume relative to the location of the positional reference device. An input/output subsystem in conjunction with processing and memory subsystems can receive a reference image data captured by a beacon sensing device combined with inertial measurement information from inertial measurement units within the hand-held controller. The position and orientation of the hand-held controller can be computed based on the linear distance between a pair of beacons on the positional reference device and the reference image data and the inertial measurement information.