VR Controller Orientation via Multi-Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented and virtual reality environments, synchronizing the orientation of a controller with a head-mounted display (HMD) is challenging, leading to misalignment between physical movements and virtual interactions, which affects the user's immersive experience.

Innovation Solution

A controller equipped with a multi-axis magnetic field sensor, accelerometer, gyroscope, touchpad, and wireless communications circuit, which communicates movement data based on geomagnetic, acceleration, and angular velocity data to a computing device to synchronize the HMD and controller positions, allowing for precise interaction within the virtual environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors (magnetic field sensor, accelerometer, gyroscope) are integrated into the controller, then measurement precision and synchronization accuracy are improved, but device complexity increases

Engineering Contradiction:
Improvecontroller orientation measurement precisionVSAvoidcontroller structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensors (magnetic field sensor, accelerometer, gyroscope) into a single integrated controller unit. This merging approach enables comprehensive orientation measurement while maintaining a unified device structure, resolving the contradiction between measurement precision and device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller is designed as a multi-functional device that simultaneously performs magnetic field sensing, acceleration measurement, and rotational velocity detection. This universal design allows a single device to achieve multiple measurement functions, improving precision without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If the controller continuously communicates movement data to the computing device, then synchronization accuracy is improved, but energy consumption increases

Engineering Contradiction:
ImproveHMD-controller synchronization reliabilityVSAvoidcontroller energy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The controller communicates movement data periodically or at specific intervals rather than continuously. This periodic communication approach maintains synchronization reliability by providing regular updates while reducing energy consumption compared to continuous data transmission.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If the threshold value for initiating communication is lowered, then measurement precision and responsiveness are improved, but energy consumption and communication overhead increase

Engineering Contradiction:
Improvemovement detection precisionVSAvoidcontroller energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The threshold value for initiating communication is adjusted dynamically based on current operational conditions. This dynamic adjustment allows the system to maintain high measurement precision and responsiveness when needed while reducing communication frequency and energy consumption during stable periods, resolving the contradiction between precision and energy usage.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution ensures that physical movements in the real world are accurately translated into corresponding actions in the virtual environment, enhancing user interaction and immersion by maintaining synchronization between the controller and HMD.

Implementation Method 1

obtain geomagnetic field data from a multi-axis magnetic field sensor

Methodology Applied
Scientific EffectMagnetic field sensing: Magnetic Field

Implementation Method 2

obtain acceleration data describing a direction and a magnitude of force affecting the controller from a multi-axis accelerometer

Methodology Applied
Scientific EffectAcceleration measurement: Accelerometer

Implementation Method 3

obtain angular velocity data describing a rotational position of the controller from a gyroscope

Methodology Applied
Scientific EffectRotational velocity sensing: Gyroscope

Data Source

PatentUS10545584B2Virtual/augmented reality input device
Publication Date: 2020.01.28 GOOGLE LLC
  • US10545584B2 patent drawing
  • US10545584B2 patent drawing
  • US10545584B2 patent drawing

AI summary

A controller configured to control a pointer in a virtual reality environment includes a multi-axis magnetic field sensor, a multi-axis accelerometer, a gyroscope, a touchpad, and a wireless communications circuit. The controller can also include a processor and a memory storing instructions that when executed by the processor, cause the processor to obtain geomagnetic field data from the multi-axis magnetic field sensor, obtain acceleration data describing a direction and a magnitude of force affecting the controller from the multi-axis accelerometer, and obtain angular velocity data describing a rotational position of the controller from the gyroscope. The processor can communicate movement data to a computing device configured to generate a rendering of the virtual reality environment, the movement data describing an orientation of the controller wherein the movement data is based on at least one of the geomagnetic field data, the acceleration data, or the angular velocity data.