Two-Hand Gesture Detection with Distributed EMG-MEMS Wearables

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture recognition systems using single wearable devices are limited in detecting complex two-hand gestures and face challenges in accurately interpreting simultaneous or sequential movements due to disruptions in the motor system, such as damage to the motor cortex or spinal cord, and require additional computational power for processing.

Innovation Solution

A system utilizing two wearable devices, each equipped with MEMS sensors and EMG electrodes, communicates via body contact or wireless protocols to capture and process dual-hand gestures using Dynamic Time Warping (DTW) algorithms, integrating MEMS sensors for motion detection and EMG signals to recognize complex hand movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a single wearable device is used for gesture recognition, then the device complexity is reduced, but the ability to detect two-hand gestures is limited

Engineering Contradiction:
Improvegesture detection capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the gesture recognition task into two separate wearable devices, each worn on one wrist. Each device independently detects local gestures and sends data to a central processing unit, allowing the system to recognize two-hand gestures while keeping individual device complexity low.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A central processing unit acts as an intermediary that receives gesture data from both wearable devices, processes the combined information, and performs the final gesture recognition. This mediator coordinates the data from multiple sources to achieve comprehensive two-hand gesture detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple wearable devices are used to detect two-hand gestures, then the gesture recognition accuracy is improved, but the computational power requirement increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidcomputational power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The system extracts the computationally intensive gesture recognition algorithm from the wearable devices and places it in a separate central processing unit. The wearable devices only perform lightweight data collection and transmission, while the heavy computational work is done externally, reducing the power requirements of the wearable devices.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The gesture recognition algorithm is implemented as a separate software module that can be copied to different processing units. This allows the complex algorithm to run on a powerful external system rather than being embedded in each wearable device, reducing their computational burden.

Inventive Principle:
Principle #26Copying

3Measurement precision

If EMG sensors and accelerometers are integrated in wearable devices, then the gesture detection precision is improved, but the device complexity increases

Engineering Contradiction:
Improvemovement detection accuracyVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system combines EMG sensors and accelerometers into integrated sensor modules within each wearable device. These multiple sensor types work together to provide complementary information about muscle activity and motion, improving gesture detection precision while sharing the complexity burden across both devices.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate recognition of complex two-hand gestures with reduced computational requirements, enhancing interaction capabilities with virtual reality environments and electronic devices.

Implementation Method 1

Each wrist band includes an accelerometer capable of detecting three axes acceleration

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

EMG is a technique to measure electrical signals that travels through the nervous system of a person to control muscle movements of the person's body

Methodology Applied
Scientific EffectElectromyography:

Data Source

PatentUS12429956B1Method and system to detect two-hand gestures
Publication Date: 2025.09.30 STMICROELECTRONICS INT NV
  • US12429956B1 patent drawing
  • US12429956B1 patent drawing
  • US12429956B1 patent drawing

AI summary

A wearable device includes an accelerometer, at least three electrodes to detect electromyography signal, a communication circuitry, and a processor circuitry. A user wears a primary and a secondary wearable device on two limbs. When the user performs a two-hand gesture, the wearable devices detect a primary and a secondary movement pattern. The primary device recognizes the two-hand gesture from the primary and secondary movement pattern.