FMCW Radar Gesture Recognition via Hidden Markov Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing radar systems struggle with accurately recognizing gestures using millimeter wave radar, as they fail to effectively handle the complex scattering responses from human hands at short ranges, which are not adequately described by traditional models and result in poor classification accuracy due to interference from other objects.

Innovation Solution

The implementation of a Frequency Modulated Continuous Wave (FMCW) radar system operating at 77 GHz, combined with Hidden Markov Models (HMMs) for gesture recognition, which extracts and processes range and velocity information to create time-velocity diagrams, reducing interference and improving classification by using micro-Doppler analysis and Gaussian parameterization to compress feature vectors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional radar models are used for gesture recognition, then the system is simpler to implement, but classification accuracy deteriorates due to inadequate description of complex scattering responses from human hands

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the raw radar signal into a time-velocity diagram by changing the representation parameters from time-domain signals to velocity-domain spectrograms. This parameter transformation enables the system to capture micro-Doppler characteristics of hand gestures while maintaining computational tractability through established signal processing techniques.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces a time-velocity diagram as an intermediary representation between the raw radar signal and the gesture classification. This intermediary transforms the complex scattering response into a more interpretable format that reveals gesture-specific patterns, bridging the gap between raw data and classification without requiring overly complex models.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If feature vector dimension is reduced through compression, then processing efficiency improves, but information loss may occur affecting recognition performance

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidfeature information loss
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent extracts only the most relevant features for gesture recognition by computing time-velocity diagrams that focus on the Doppler frequency content specific to hand movements. This selective extraction removes irrelevant information while preserving the essential gesture characteristics, achieving dimensionality reduction without significant information loss.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from analyzing signals in the time domain to analyzing them in the velocity domain through Fourier transformation. This dimensional change allows the system to compress the feature representation while maintaining recognition accuracy by exploiting the structure of the data in a different domain where gesture-specific patterns are more concentrated.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If FMCW radar operates at 77 GHz for high resolution imaging, then measurement precision improves, but susceptibility to interference from other objects increases

Engineering Contradiction:
Improveimaging resolutionVSAvoidinterference from other objects
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies range gating to focus the analysis on a specific local region in range-velocity space where the gesture of interest occurs. By restricting the time-velocity diagram computation to a localized range window around the hand, the system maintains high measurement precision for the gesture while filtering out interference from other objects at different ranges.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach achieves accurate gesture recognition with an overall accuracy of 82.3% for 30-frame gestures and maintains sufficient recognition performance for shorter frame counts, while significantly reducing feature vector dimensionality, thus overcoming the limitations of traditional systems in handling complex human hand responses and interference.

Implementation Method 1

Frequency Modulated Continuous Wave (FMCW) radar system operating at 77 GHz

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

micro-Doppler analysis to find the distribution of energy mass in the range-velocity space

Methodology Applied
Scientific EffectDoppler effect: Doppler Effect

Data Source

PatentUS11054913B2Hidden markov model-based gesture recognition with FMCW radar
Publication Date: 2021.07.06 TEXAS INSTRUMENTS INC
  • US11054913B2 patent drawing
  • US11054913B2 patent drawing

AI summary

A system includes a frequency modulated continuous wave (FMCW) transceiver, a processor, and a memory. The memory stores program instructions that, when executed by the processor, cause the system to receive a signal representative of an FMCW signal reflected from an object of interest, apply a first Fourier transform to the signal to obtain range data, identify a subset of the range data corresponding to a region of interest, apply a second Fourier transform on the identified subset of the range data to obtain velocity data corresponding to the identified subset of the range data, and identify a gesture performed by the object of interest based on at least a portion of velocity data.