Multi-sensor signal fusion method based on deep learning for gait classification

A multi-sensor and signal fusion technology, applied in the field of biological signal sensing, can solve the problems of inability to obtain complete and comprehensive information of the object, and the data is thin, and achieve the effect of improving the classification effect and improving the accuracy.

Pending Publication Date: 2019-05-21
FUDAN UNIV
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Based on sensors, there are many single-sensor solutions based on lower limb movement information, based on lower limb surface electromyography, and based on plantar pressure distribution. However, compared with multiple sensors, the data of a single sensor is thin, and it cannot obtain complete and comprehensive information about the object.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-sensor signal fusion method based on deep learning for gait classification
  • Multi-sensor signal fusion method based on deep learning for gait classification
  • Multi-sensor signal fusion method based on deep learning for gait classification

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

[0040] The present invention provides a multi-sensor signal fusion method based on deep convolutional neural network for gait classification, the schematic diagram of the method structure is as follows figure 1 shown. This method adopts the following steps to realize:

[0041] Step 1, collecting normal gait information. Fix the IMU and SEMG hardware acquisition system on the outer sides of the left and right calves with straps, where the Y axis of the IMU is perpendicular to the horizontal plane, the X axis is perpendicular to the coronal plane of the human body, and the Z axis is perpendicular to the sagittal plane of the human body. The two channels of SEMG were attached to the gastrocnemius muscle belly and the tibialis anterior muscle belly respectively. The distance between the two electrodes of each channel was 4 cm, and the reference ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of biological feature recognition, and particularly relates to a multi-sensor signal fusion method based on deep learning for gait classification. Abnormalgaits are classified by constructing a deep neural network, and multi-source heterogeneous information source data from an IMU inertial sensing unit and SEMG surface electromyography are fused by utilizing a convolutional neural network; The fusion content comprises a data layer (CNN input layer), a feature layer (CNN pooling layer 1 to convolutional layer 2) and a decision layer (CNN output layer) fusion, so that multi-source heterogeneous sensor information is completely extracted, the classification precision of the classifier is improved, the data preprocessing workload is reduced, and the classification accuracy and the judgment efficiency are improved. It is verified that the classification effect of the method in multiple abnormal gait classification tasks is remarkably improved compared with that of a single-mode sensor, and in an abnormal gait six-classification task mentioned in the embodiment, the classification accuracy reaches 99.15%, and is improved by about three percentage points compared with that of a single IMU information source CNN network.

Description

technical field [0001] The invention belongs to the technical field of biological signal sensing, and in particular relates to a multi-sensor signal fusion method for gait classification. Background technique [0002] Gait refers to the posture shown when people walk, and is one of the important biological characteristics of the human body. Abnormal gait is mostly related to the lesion. As an important feature reflecting the health status and behavior ability of the human body, accurate and credible gait information can be obtained in time, and the abnormal gait classifier can be trained to give timely early warning of abnormal gait, and it can be monitored for a long time. Monitoring and evaluation have important guiding significance in medical diagnosis and disease prevention. [0003] Multi-sensor data fusion MSDF (Multi-sensor Data Fusion) technology was first widely used in the military. Recently, with the increasing maturity of biomedical information collection techno...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62A61B5/11G06N3/04G06N3/08
Inventor 殷书宝陈炜朱航宇王心平
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products