Finger gesture interaction system of intelligent wheelchair and interaction method thereof

Abstract

The invention relates to the field of intelligent wheelchair interaction, and particularly discloses a finger gesture interaction system of an intelligent wheelchair and an interaction method of the finger gesture interaction system. The method comprises the following steps: performing high-dimensional feature extraction on an acceleration signal, an angle signal and an electromyographic signal by adopting an encoder comprising a one-dimensional convolutional layer and a full-connection layer and a convolutional neural network, and fusing an acceleration feature vector, an angle feature vector and an electromyographic feature map based on a Gaussian density map and Gaussian responsiveness distribution, on the basis of feature distribution of the myoelectricity feature map, classification vectors of actual high-dimensional data distribution of the response acceleration features and the angle features are obtained, feature fusion is effectively achieved, and classification accuracy is improved. In this way, the interaction instruction of the gesture action type can be recognized and judged more accurately, and then the control effect of the intelligent wheelchair is better.

Description

technical field [0001] The present invention relates to the field of intelligent wheelchair interaction, and more particularly, to a finger gesture interaction system for an intelligent wheelchair and an interaction method thereof. Background technique [0002] Most of the existing electric wheelchairs use a joystick control method, which cannot be controlled remotely, and the interaction method is not intuitive and convenient. [0003] At present, gesture recognition technology is also used in the command recognition and control of walking aids, but in the process of gesture recognition, gesture recognition is mostly based on a single sensor, so less information is obtained, and the recognition results are easily affected. interference from many factors. Therefore, in order to more accurately identify and judge the interaction instructions of the gesture action type, a finger gesture interaction system for an intelligent wheelchair is desired. SUMMARY OF THE INVENTION ...

AI Technical Summary

Problems solved by technology

[0002] Most of the existing electric wheelchairs use the joystick control method, which cannot be controlled remotely, and the interaction method is not intuitive and convenient enough. The control method of the wheelchair also lacks intelligence, which cannot meet the increasing user needs with the development of science and technology.

[0003] At present, some gesture recognition technology is applied to the command recognition control of walking aids, but in the gesture recognition process, most of them are based on a single sensor for gesture recognition, so that less information is obtained, and the recognition results are easily affected. The interference of many factors

Images