Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Gesture recognition method and device, computer storage medium and electronic equipment

A gesture recognition and gesture action technology, applied in the field of image recognition, can solve the problem of reducing the recognition rate of gesture trajectory, and achieve the effect of improving the detection recognition rate, solving the change of gesture trajectory, and universal applicability.

Pending Publication Date: 2020-12-22
XIAN LINGKONG ELECTRONICS TECH CO LTD
View PDF18 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In a dynamic gesture recognition system, illumination changes, complex backgrounds, and skin color interference will all affect the effect of dynamic gesture recognition. The dynamic gesture trajectory is usually composed of a series of continuous points. How to determine the starting point of an effective dynamic gesture trajectory? It is very important, it is related to whether the gesture track can be completely extracted and the recognition rate of the gesture track can be reduced

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition method and device, computer storage medium and electronic equipment
  • Gesture recognition method and device, computer storage medium and electronic equipment
  • Gesture recognition method and device, computer storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] The present disclosure firstly provides a gesture recognition method, such as figure 1 Shown include the following steps:

[0033] Step S110: From the video frame containing the hand image, segment the hand area by the threshold segmentation method, and detect gestures; obtain the coordinates of the center of mass of the hand area; the hand image is set with a specific color; in order to avoid other non-operator hands in the video The influence of the operator, the hand of the operator who performs the gesture wears a glove of a specific color (in this embodiment, the specific color is selected as red), so that it is easy to detect the operator's hand in each frame of the video image, so that the follow-up Gesture segmentation and feature extraction; step S120: when the detected gesture action matches the preset start action, start recording the coordinates of the center of mass of the hand area; until the detected gesture action matches the preset end action; at each ...

Embodiment 2

[0057] Based on the same inventive concept as the gesture recognition method described in the first embodiment, this embodiment discloses a gesture recognition device. The gesture recognition device in the embodiment of the present disclosure includes an acquisition module, a judgment module and a recognition module.

[0058] In the embodiment of the present disclosure, the collection module is used to segment the hand area from the video frame containing the hand image by threshold segmentation method, and detect gesture actions; obtain the centroid coordinates of the hand area.

[0059] In the embodiment of the present disclosure, the judging module is used to detect gestures; when the detected gesture matches the preset start action, start recording the centroid coordinates of the hand area; until the detected gesture matches the preset end action until.

[0060] In the embodiment of the present disclosure, the identification module is used to use the recorded centroid coor...

Embodiment 3

[0063] Based on the same inventive concept as the gesture recognition method described in the first embodiment, this embodiment also discloses a computer storage medium on which a computer program is stored; the computer program described in the embodiment of the present disclosure When executed by the processor, the gesture recognition method described in the above-mentioned embodiment 1 is realized. The execution process includes: after obtaining the camera frame image, performing pre-processing operations such as image enhancement on the frame image, so that the hand in the frame image is clearer, which is beneficial to the next step. One step extracts the area of ​​the hand according to the characteristics of the hand, and then extracts the area of ​​the hand in the enhanced image. After the area of ​​the hand is extracted, obtain the coordinates of the center of mass of the hand area; at the same time, detect whether there is a sign of the start gesture, and then detect the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A gesture recognition method and device, a computer storage medium and electronic equipment belong to the field of image recognition. The method is characterized by comprising the following steps: segmenting a hand area from a video frame containing a hand image through a threshold segmentation method, and detecting a gesture action; obtaining a centroid coordinate of the hand area; when the detected gesture action is matched with a preset starting action, starting to record a mass center coordinate of the hand area until the detected gesture action is matched with the preset ending action; and taking the recorded centroid coordinate of the hand area as effective track coordinate, performing track type identification on the effective track coordinate, and providing an identification resultto preset finger-reading equipment for identification response. The problem of gesture recognition errors caused by gesture track changes caused by execution of different executors of the same gesture can be effectively solved, the detection and recognition rate of the dynamic gesture can be greatly improved, the method has universal applicability and real-time performance, and the method can beapplied to the industries of actual life, industry, control, smart home and the like.

Description

technical field [0001] The invention belongs to the field of image recognition, and in particular relates to a gesture recognition method, device, computer storage medium and electronic equipment. Background technique [0002] At present, the research on gesture recognition is mainly based on computer vision, and vision-based gesture recognition mainly includes static gesture recognition and dynamic gesture recognition. Static gesture recognition is aimed at changes in hand shapes, expressing different meanings through different hand shapes that are recognized, corresponding to a point in space, excluding the trajectory of gesture movement. Dynamic gesture recognition is composed of a series of gesture actions, and mainly studies continuous hand shape changes and trajectory changes in gesture video sequences. Dynamic gestures have variability in the movement process of gestures, and the complex actual environment increases the difficulty of gesture recognition. The variabi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T7/11G06T7/136G06T7/66G06T7/13
CPCG06T7/11G06T7/136G06T7/66G06T7/13G06T2207/10016G06T2207/30241G06V40/28
Inventor 宁瑞芳孙景峰李权陈永辉
Owner XIAN LINGKONG ELECTRONICS TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products