Gesture recognition method and device

A gesture recognition and gesture technology, applied in the field of gesture recognition, can solve problems such as large influence of external factors, no obvious distinction, and inability to effectively segment sign language words, so as to achieve the effect of improving the quality of conversation and the accuracy rate

CN112686132APending Publication Date: 2021-04-20NANJING INST OF TECH
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2021-04-20

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a gesture recognition method and device, and the method and device can achieve the real-time interaction between a deaf-mute and a common person, and achieve the collection of the hand movement posture information of a deaf-mute user through an electromyographic signal sensor, a posture signal sensor and an angle sensor in a flexible glove; via the fusion analysis of the collected data, the method synchronously analyzes data into a gesture frame diagram for output, carries out matching query on the gesture frame diagram and the established word diagram matching database to obtain a voice keyword corresponding to the gesture of the deaf-mute, and outputs a voice expression after the voice keyword is processed by a voice module; and in addition, the spoken language signals of the ordinary person are processed to obtain a gesture posture frame diagram corresponding to the voice of the ordinary person, so that real-time interaction between the deaf-mute and the ordinary person is realized.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of gesture recognition, and in particular designs a gesture recognition method and device. Background technique

[0002] Since there are many movements of the human hand and the gestures are complex, different movements will also have overlapping parts, making gesture recognition one of the current research problems. Among the complex gestures, sign language is the main language for the deaf-mute to communicate. Sign language is an extremely complex language system and relies on hand movements as the main way for the deaf-mute to communicate with other people. Because sign language is extremely difficult to understand, it is difficult for normal people to accurately recognize the gestures of deaf-mute people unless they are professionals.

[0003] At present, the existing sign language recognition methods can be divided into: methods based on data gloves, methods based on myoelectricity and methods based on...

Examples

Embodiment Construction

[0025] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0026] As an embodiment of the present invention, such as Figure 5 As shown, a gesture recognition device of the present invention may specifically be a gesture recognition smart wearable device, the smart wearable device includes a smart bracelet worn on the wrist of a deaf-mute and a flexible glove worn on the hand of a deaf-mute, Among them, the smart bracelet integrates myoelectric signal sensor, attitude signal sensor, main control module, communication module, voice module and display module; the flexible angle sensor is built in the finger fitting part of the flexible glove; figure 1 As shown, the myoelectric signal sensor in the smart bracelet, the attitude signal sensor and the angle sensor in the flexible glove collect the hand movement and posture information of the deaf-mute user, and perform data fusion analysis, and sy...