Gesture posture recognition key frame extraction method and device and readable storage medium

An extraction method and key frame technology, applied in the computer field, can solve problems such as inability to extract clear images, achieve the effects of reducing reasoning time, strong anti-interference, and enhancing customer experience

Active Publication Date: 2021-04-30
NANCHANG VIRTUAL REALITY RES INST CO LTD
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For this reason, an object of the present invention is to propose a kind of gesture recognition key frame extraction method, to solve the problem that prior art can not extract clearer image as the key frame of prediction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture posture recognition key frame extraction method and device and readable storage medium
  • Gesture posture recognition key frame extraction method and device and readable storage medium
  • Gesture posture recognition key frame extraction method and device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0069] see figure 1 , the key frame extraction method for gesture and posture recognition proposed by an embodiment of the present invention includes steps S101 to S105.

[0070] S101. Perform hand object detection on the target image through the trained deep learning model for hand detection, so as to obtain graphic information of the smal...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gesture recognition key frame extraction method and device and a readable storage medium, and the method comprises the steps: carrying out hand target detection of a target image by a trained hand detection deep learning model, so as to obtain the graphic information of a minimum enclosing rectangle of a hand region; carrying out hand region segmentation to obtain an intermediate image with only hands; calculating the entropy of each frame of intermediate image in the first moment and the entropy of each frame of intermediate image in the second moment; binarizing the intermediate image with the maximum entropy value corresponding to the first moment to obtain a first binarized image, binarizing the intermediate image with the maximum entropy value corresponding to the second moment to obtain a second binarized image, and calculating a hand overlapping rate of the first binarized image and the second binarized image; and determining extraction of the key frame according to the hand overlapping rate. According to the invention, the problem that a clear image cannot be extracted as a predicted key frame in the prior art can be solved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a method, device and readable storage medium for extracting key frames for gesture and gesture recognition. Background technique [0002] Gesture recognition is an important means of human-computer interaction. In VR (Virtual Reality, virtual reality technology) human-computer interaction, users can adjust the volume or control other virtual mobile buttons through virtual gesture recognition. [0003] Due to hardware processing speed and product experience requirements, gesture estimation needs to meet real-time requirements. Therefore, not all images in the video stream are used for 3D gesture recognition, but some key frames are extracted for recognition. The existing solutions mainly There are fixed time extraction of image frames, random sampling, or frame difference extraction, etc. These methods cannot extract clearer images as key frames for prediction, and blurr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06F3/01G06T7/136G06T7/90
CPCG06T7/136G06T7/90G06F3/017G06T2207/10021G06V40/28
Inventor 毛凤辉郭振民熊斌
Owner NANCHANG VIRTUAL REALITY RES INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products