Unlock instant, AI-driven research and patent intelligence for your innovation.

Video gesture recognition method and device based on skin color detection and deep learning

A deep learning and skin color detection technology, applied in the field of gesture recognition, can solve the problems of low gesture recognition efficiency and low recognition accuracy, and achieve the effects of improving gesture efficiency and gesture recognition accuracy, improving recognition effect, and shortening time.

Inactive Publication Date: 2021-08-03
WUHAN UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the present invention provides a video gesture recognition method and device based on skin color detection and deep learning to solve or at least partially solve the problems of low gesture recognition efficiency and low recognition accuracy existing in the prior art. question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video gesture recognition method and device based on skin color detection and deep learning
  • Video gesture recognition method and device based on skin color detection and deep learning
  • Video gesture recognition method and device based on skin color detection and deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] This embodiment provides a method for recognizing video gestures based on skin color detection and deep learning, please refer to figure 1 , the method includes:

[0058] First, step S1 is executed: video data is acquired, and the video data is composed of RGB images.

[0059] Specifically, devices such as a camera can be used to obtain video data, and the resolution of the identification data varies according to the configuration of the device, for example, it can be 1280*720. RGB image is the most important mode in digital images. RGB mode is an additive mode. When the values ​​of R, G, and B all reach the maximum value, the three colors are synthesized into white.

[0060] Then step S2 is performed: based on the preset skin color feature segmentation model, the video data is processed frame by frame, the skin area is segmented, and the image corresponding to the skin area is binarized to obtain a binarized image.

[0061] Specifically, the preset skin color feature...

Embodiment 2

[0121] This embodiment provides a video gesture recognition device based on skin color detection and deep learning, please refer to Figure 7 , the device consists of:

[0122] Video data acquiring module 201, for acquiring video data, described video data is made up of RGB image;

[0123] The skin area segmentation module 202 is used to process the video data frame by frame based on the preset skin color feature segmentation model, segment the skin area, and perform binarization on the image corresponding to the skin area to obtain a binarized image;

[0124] The hand contour extraction module 203 is used to extract the hand contour from the binarized image;

[0125] The hand recognition module 204 is configured to recognize the extracted hand outline based on a preset gesture recognition model, wherein the preset gesture recognition model is obtained by training the existing training data using a pyramid pooling module and an attention mechanism, Among them, the ...

Embodiment 3

[0144] Based on the same inventive concept, this application also provides a kind of computer equipment, please refer to Figure 8 , including a storage 601, a processor 602, and a computer program 603 stored in the memory and operable on the processor. The processor 602 implements the method in Embodiment 1 when executing the above program.

[0145] For example, the computer device may be a smart device such as a PC, a tablet computer, or a mobile phone, and the computer device only needs to have an image recognition device, such as a camera, an image sensor, and the like.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a video gesture recognition method and device based on skin color detection and deep learning. After the method acquires video data, the skin color is discriminated through a preset skin color feature segmentation model, and the skin area is segmented to obtain two Value the image, then extract the contour of the binarized image, extract the hand contour, and then use the preset gesture recognition model to recognize the extracted hand contour. The technical effect of improving the efficiency and precision of gesture recognition is realized.

Description

technical field [0001] The invention relates to the technical field of gesture recognition, in particular to a video gesture recognition method and device based on skin color detection and deep learning. Background technique [0002] Video is a common data type, while gestures are a common body language used by humans. In recent years, with the development of related disciplines such as computer vision and machine learning, human-computer interaction technology has played an increasingly important role in people's daily life. As an important part of computer science research field, human-computer interaction has gone through more than half a century and achieved many achievements. Compared with the traditional computer mouse and keyboard interaction method, human-computer interaction can give users a more convenient, fast and comfortable interactive experience. [0003] Due to the many advantages of human-computer interaction, various interactive technologies have emerged ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06T7/11G06T7/13G06T7/62G06T7/66G06T7/90G06N3/04G06N3/08
CPCG06N3/08G06T7/11G06T7/13G06T7/62G06T7/66G06T7/90G06T2207/20081G06T2207/30196G06T2207/10016G06V40/113G06V20/41G06N3/045
Inventor 种衍文黄瀚文潘少明李红
Owner WUHAN UNIV