Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Myoelectric gesture recognition method based on RNN-CNN architecture

A technology of gesture recognition and myoelectricity, which is applied in the field of physiological signal recognition, can solve problems such as improvement, long model training time, and affecting model accuracy

Active Publication Date: 2019-12-24
NANJING UNIV OF POSTS & TELECOMM
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, these two types of research still have certain limitations: the recognition method based on machine learning can recognize a small number of gestures, while the recognition method based on deep learning does not simplify the EMG signal on the one hand, which easily leads to a long model training time; In this regard, the timing of EMG signals is not fully considered, and it is easy to affect the further improvement of model accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Myoelectric gesture recognition method based on RNN-CNN architecture
  • Myoelectric gesture recognition method based on RNN-CNN architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0029]An EMG gesture recognition method based on the RNN-CNN architecture. According to the timing characteristics of the EMG signal, the gesture recognition method first uses the RNN architecture with a better processing sequence problem to perform feature extraction on each channel signal, and then uses the CNN architecture to perform feature extraction. The fused feature map is further extracted, which mainly includes the following steps:

[0030] Step 1: Data preprocessing.

[0031] Such as figure 1 As shown, after the EMG signal is obtained from the EMG acquisition device, the signal cannot generally be used directly, and several steps are required for signal processing. Assume that the sampling frequency of the EMG device is FHz, the sampling duration of each gesture is Tms, the number of channels of the device is C, and the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a myoelectric gesture recognition method based on an RNN-CNN architecture. The method comprises the following steps of performing feature extraction on each channel signal byusing an RNN architecture according to a time sequence characteristic of a myoelectric signal, and further extracting a fused feature map by using a CNN architecture, and mainly comprises the following steps of preprocessing the data, using an RNN module to perform preliminary feature extraction on the preprocessed data, using a fusion module to perform fusion processing on an output result of theRNN; using a CNN module to perform feature extraction and analysis on an output result of the fusion module; and using a classification module to judge the input gesture signal by the model output, namely judging which gesture type the electromyographic signal belongs to according to the currently input electromyographic signal. According to the method, the time sequence relevance and characteristics of the data can be effectively extracted, and meanwhile, the gesture recognition rate is improved; an extreme value point selection and splicing method is introduced at a data preprocessing stage, so that the model training time is reduced, and the mutual interference between the channels is avoided; finally, at the fusion stage, the relevance of the multiple channels is utilized, so that theidentification of the electromyographic signals is facilitated.

Description

technical field [0001] The present invention relates to the field of physiological signal recognition, in particular to a myoelectric gesture recognition method based on RNN-CNN architecture. Background technique [0002] EMG signal is a common physiological signal, which is generated by the potential change of muscle fibers, which can reflect muscle movement and provide information on body activity. The myoelectric signals of different gestures usually have certain differences, so the myoelectric signals can be used for the recognition of various hand movements, assisting the research of remote control and robotic arms. In gesture recognition based on electromyographic signals, non-invasive sensors are generally used to obtain electromyographic signals. At present, gesture recognition methods for electromyographic signals can be classified into two categories: gesture recognition methods based on machine learning, and depth-based A learned approach to gesture recognition. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/28G06N3/045G06F2218/08G06F2218/12
Inventor 孙力娟季飞龙郭剑高睿董树龙刘培宇韩崇王娟
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products