Unlock instant, AI-driven research and patent intelligence for your innovation.

Gesture recognition method and device, storage medium, electronic device

A gesture recognition and gesture technology, applied in the computer field, can solve the problems of low gesture recognition accuracy, no solution found, information loss, etc., to avoid overfitting, avoid accuracy reduction, and improve robustness.

Active Publication Date: 2021-12-21
深圳市信润富联数字科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the occlusion of the hand and the variability of the direction of the hand in some scenes, the information related to the hand in the picture is lost, resulting in a low accuracy rate of gesture recognition.
For the above-mentioned problems existing in related technologies, no effective solution has been found yet

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition method and device, storage medium, electronic device
  • Gesture recognition method and device, storage medium, electronic device
  • Gesture recognition method and device, storage medium, electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] The method embodiment provided in Embodiment 1 of the present application may be executed in a server, a computer, or a similar computing device. Take running on a computer as an example, figure 1 It is a block diagram of the hardware structure of a computer according to the embodiment of the present invention. Such as figure 1 As shown, the computer may include one or more ( figure 1 Only one is shown in ) processor 102 (processor 102 may include but not limited to processing devices such as microprocessor MCU or programmable logic device FPGA) and memory 104 for storing data. Optionally, the above computer can also A transmission device 106 for communication functions and an input and output device 108 are included. Those of ordinary skill in the art can understand that, figure 1 The shown structure is only for illustration, and it does not limit the structure of the above-mentioned computer. For example, a computer may also include figure 1 more or fewer c...

Embodiment 2

[0061] In this embodiment, a gesture recognition device is also provided, which is used to implement the above embodiments and preferred implementation modes, and what has been explained will not be repeated here. As used below, the term "module" may be a combination of software and / or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

[0062] Figure 6 is a structural block diagram of a gesture recognition device according to an embodiment of the present invention, such as Figure 6 As shown, the device includes: an acquisition module 60, an extraction module 62, and a detection module 64, wherein,

[0063] Obtaining module 60, for obtaining the gesture picture to be recognized;

[0064] The extraction module 62 is used to sequentially input the gesture pictures into the...

Embodiment 3

[0074] An embodiment of the present invention also provides a storage medium, in which a computer program is stored, wherein the computer program is set to execute the steps in any one of the above method embodiments when running.

[0075] Optionally, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for performing the following steps:

[0076] S1, acquiring a picture of a gesture to be recognized;

[0077] S2, sequentially input the gesture pictures into a multi-layer feature extraction network, and generate multiple second-type feature maps of different sizes using the multiple first-type feature maps output by the multi-layer feature extraction network;

[0078] S3. Output gesture category information and gesture key point information by using a multi-scale detection module based on the plurality of second-type feature maps.

[0079] Optionally, in this embodiment, the above-mentioned storage medium may include but not lim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a gesture recognition method and device, a storage medium, and an electronic device, wherein the method includes: acquiring gesture pictures to be recognized; inputting the gesture pictures into a multi-layer feature extraction network in sequence, and using the multi-layer Multiple first-type feature maps output by the feature extraction network generate multiple second-type feature maps of different sizes; based on the multiple second-type feature maps, a multi-scale detection module is used to output gesture category information and gesture key point information. Through the present invention, the multi-scale detection module is used to output gesture category information and gesture key point information, which avoids the decrease in the accuracy of gesture recognition and detection caused by the occlusion of the hand and the variability of the gesture direction of the hand during the gesture detection process, and improves complex scenes. The robustness solves the technical problem of low gesture recognition rate in related technologies.

Description

technical field [0001] The present invention relates to the field of computers, in particular to a gesture recognition method and device, a storage medium, and electronic equipment. Background technique [0002] In related technologies, gesture is a form of non-verbal communication, which can be used in various fields such as communication between deaf people, robot control, Human Computer Interaction (HCI, Human Computer Interaction), home automation and medical applications. [0003] In related technologies, gesture recognition has adopted many different technologies, which are mainly divided into three categories: 1. Template matching technology matches the characteristic parameters of the gesture to be recognized with the pre-stored template characteristic parameters, and measures the difference between the two similarity to complete the recognition task. For example, transform the edge images of gestures to be recognized and template gestures into the Euclidean distanc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06N3/08
CPCG06N3/08
Inventor 钱程浩黄雪峰熊海飞
Owner 深圳市信润富联数字科技有限公司