Magnetic Field Gesture Tracking for Occluded VR Inputs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional wearable VR or AR devices face challenges in input mechanisms, particularly when used with head-mounted displays, as they are inconvenient and awkward, especially when gestures are occluded from the field of view, and inertial measurement units suffer from drift errors requiring frequent calibration.

Innovation Solution

A wearable device, such as a glove, uses magnetic field generators and sensors to determine the spatial positions of tracked points on the user's body, allowing for accurate gesture identification by generating and detecting magnetic fields, which are then used to create a representative state descriptor for gesture recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If computer vision techniques are used to identify gestures from image capture devices, then gesture identification can be achieved, but the effectiveness decreases when body portions are occluded from the field of view

Engineering Contradiction:
Improvegesture identification effectivenessVSAvoidocclusion limitation
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent replaces optical vision-based gesture recognition with magnetic field-based detection. Magnetic field sensors detect magnetic fields generated by magnets on the user's body, allowing gesture identification without line-of-sight requirements. This substitution of detection mechanism eliminates the occlusion limitation inherent in camera-based systems, as magnetic fields can penetrate through objects and body parts.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If inertial measurement units are used to track gestures, then gesture tracking is possible, but drift error occurs requiring frequent sensor calibration

Engineering Contradiction:
Improvegesture tracking accuracyVSAvoidcalibration frequency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent substitutes inertial measurement units with magnetic field sensors and magnets. Instead of using accelerometers and gyroscopes that accumulate drift error over time, the system uses magnetic field detection that does not suffer from temporal drift. The magnetic field strength and direction provide stable, non-drifting measurements that eliminate the need for frequent calibration corrections.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If conventional input mechanisms with limited buttons and touch areas are used, then device simplicity is maintained, but user convenience and operability decrease

Engineering Contradiction:
Improveinput mechanism simplicityVSAvoiduser convenience
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent creates a virtual representation of the user's hand and gestures through magnetic field detection. Instead of physical buttons or touch screens, the system detects the position and motion of magnets on the user's body to create a virtual hand model that can interact with digital interfaces. This copying of physical gestures into virtual space provides intuitive control without requiring physical input devices.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides a more effective and accurate method for gesture recognition, reducing the limitations of occlusion and drift errors, enabling reliable interaction with VR or AR systems without the need for frequent calibration.

Implementation Method 1

magnetic fields generated by a magnetic field generators that are located at the tracked points and detected by magnetic field sensors at known positions

Methodology Applied
Scientific EffectMagnetic field: Magnetic Field

Data Source

PatentUS11347310B2Tracking positions of portions of a device based on detection of magnetic fields by magnetic field sensors having predetermined positions
Publication Date: 2022.05.31 META PLATFORMS TECHNOLOGIES LLC
  • US11347310B2 patent drawing
  • US11347310B2 patent drawing
  • US11347310B2 patent drawing

AI summary

A wearable device includes a plurality of magnetic field generators positioned at different points to be tracked. The magnetic field generators emit magnetic fields that are sensed by a plurality of magnetic field sensors having known positions relative to each other. The wearable device may have magnetic field generators placed at tracked points corresponding to portions of the fingers and the palm of the device, and magnetic field sensors located at predetermined positions. A position analyzer determines the spatial position of the tracked points on the palm as well as the tracked points on the fingers from the output signals of the magnetic field sensors. From the determined spatial positions of the tracked points, a gesture identification system determines a gesture corresponding to the spatial positions of the points of the wearable device where the magnetic field generators are positioned.