Domain Adaptation for Surface Electromyography Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The electromyography gesture recognition system faces performance degradation due to domain shift caused by factors like electrode shift, muscle fatigue, and individual differences, leading to significant differences in surface electromyography signals between users and sessions, which conventional domain adaptation methods fail to address effectively.

Innovation Solution

A domain adaptation method that fuses results from multiple target domain gesture recognition models under different source-specific views by constructing target domain gesture recognition models based on source domain models and domain adaptation models, using a feature extractor and gesture classifier with convolutional neural networks, recurrent neural networks, and fully connected layers, and determining gesture categories based on weights under each source-specific view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional domain adaptation methods are used to handle domain shift, then the model can be trained on source domain data, but the recognition accuracy degrades when applied to target domain data from different users, sessions, or muscle fatigue states

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidcross-domain generalization ability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent segments the domain adaptation problem into multiple source-specific views, where each view corresponds to a specific source domain (user, session, or fatigue state). Instead of treating all source domains uniformly, the method divides them into separate adaptation streams, each with its own adaptation model. This segmentation allows the system to capture domain-specific characteristics while maintaining overall robustness, directly addressing the degradation in recognition accuracy when applying conventional single-domain adaptation methods to multi-source scenarios.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal gesture recognition model that can function across multiple domains by integrating multiple source-specific adapted models. The final recognition system universally handles data from any source domain by combining the outputs of domain-specific adaptation pathways. This multi-functionality enables the system to maintain high recognition accuracy across different users, sessions, and fatigue states, resolving the contradiction between reliability in specific domains and adaptability across domains.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If training data from multiple source domains is used to improve model robustness, then the model becomes more complex, but conventional methods ignore different associations between different source domains and the target domain

Engineering Contradiction:
Improvemodel robustnessVSAvoidmodel structure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the complex multi-source domain adaptation problem into manageable source-specific sub-problems. Each source domain is handled by a dedicated adaptation module that processes data independently before aggregation. This segmentation reduces the complexity of learning all domain associations simultaneously while maintaining robustness through multiple specialized pathways, rather than using a single complex model that tries to handle all domains uniformly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimensional structure by organizing multiple source domains into distinct view layers. Instead of flattening all source domains into a single feature space, the method creates a multi-dimensional architecture where each dimension corresponds to a source-specific view. This dimensional organization allows the model to capture complex associations between different source domains and target domain without requiring excessive model complexity, as the structure naturally encodes domain relationships.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of manufacture

If a single target domain gesture recognition model is trained, then the training process is simpler, but it cannot effectively handle the multi-source property of surface electromyography signals from different users, sessions, and fatigue states

Engineering Contradiction:
Improvemodel training simplicityVSAvoidmulti-source domain adaptation capability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent segments the single model training process into multiple parallel training streams, each focused on a specific source domain. This segmentation maintains relative training simplicity by allowing each source-specific model to be trained independently on its corresponding data, avoiding the complexity of joint training while still achieving multi-source adaptability through the aggregation of specialized models.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges multiple source-specific adapted models into a unified target domain gesture recognition system. The individual models, each trained on specific source domain data, are combined through their outputs to form the final recognition decision. This merging approach enables the system to handle the multi-source property of electromyography signals effectively while maintaining the training simplicity of separate specialized models, rather than requiring a single complex model to learn all source domain characteristics simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240168554A1Domain adaptation method and system for gesture recognition
Publication Date: 2024.05.23 NANJING UNIV OF SCI & TECH
  • US20240168554A1 patent drawing
  • US20240168554A1 patent drawing
  • US20240168554A1 patent drawing

AI summary

An objective of the present disclosure is to provide a domain adaptation method and system for gesture recognition, which relates to the field of gesture recognition technologies. The domain adaptation method for gesture recognition includes: obtaining a to-be-recognized target domain surface electromyography signal of a user; separately inputting the to-be-recognized target domain surface electromyography signal into multiple target domain gesture recognition models, to obtain target domain gesture recognition results under multiple source-specific views, where source domains of training data used by different target domain gesture recognition models are different; and determining a gesture category of the to-be-recognized target domain surface electromyography signal according to the gesture recognition results under multiple source-specific views and a weight under each source-specific view.