MA-YOLO dynamic gesture rapid identification method based on double-path segmentation

A dynamic gesture and recognition method technology, applied in the field of image processing, can solve the problems of inability to real-time, consume a lot of time, and can not meet the needs of use, and achieve the effect of reducing the recognition speed, improving the accuracy, and enabling self-learning

Pending Publication Date: 2021-03-12
HARBIN ENG UNIV
View PDF12 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, because the hand itself is a complex part of the human body, it has the characteristics of spatial position differences, diversity, and complexity, and the incompatibility of the human body itself
Moreover, in the process of gesture recognition, the existing gesture recognition technology is greatly affected by external environment, background and other factors, and there is no way to reduce the influence of external factors in gesture recognition on the recognition process, which is a major bottleneck of gesture recognition
At the same time, the existing gesture recognition technology consumes too much time in the recognition process, and there is no way to complete the implementation of gesture instructions in real time. However, the implementation of instructions cannot be completed in real time. Meet the use in daily life

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • MA-YOLO dynamic gesture rapid identification method based on double-path segmentation
  • MA-YOLO dynamic gesture rapid identification method based on double-path segmentation
  • MA-YOLO dynamic gesture rapid identification method based on double-path segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0042] The present invention creates a new MA-YOLO network and at the same time creates a new hand image segmentation method, which accelerates the speed of gesture recognition and also solves the problem of low recognition accuracy in complex backgrounds.

[0043] In order to achieve the above object, the technical solution of the present invention is a method for fast recognition of MA-YOLO dynamic gestures based on two-way segmentation, comprising the following steps:

[0044] A kind of MA-YOLO dynamic gesture fast recognition method based on two-way segmentation, it is characterized in that, described method comprises:

[0045] Step 1: Process and segment the obtained RGB (R, G, B are the colors representing the three channels of red, green, and blue) information and depth information;

[0046] Step 2: Input the segmented hand im...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a dynamic gesture rapid recognition method based on double-path segmentation MAYOLO, and the method comprises the steps: 101, proposing an MAYOLO algorithm, converting a YOLO backbone network into a lighter resnet34 network for feature extraction, adding an ASPP module to change a receptive field, adding an attention mechanism, and carrying out the autonomous learning better; 102, a complex environment gesture recognition technology based on double-channel segmentation is provided, and gesture recognition in a complex environment can be achieved by combining double-channel segmentation with a depth information segmentation image and a skin color segmentation image. Compared with a previous basic method, the method has the advantages that the precision is improved by5.4%, and the recognition speed is reduced to 50 ms or below.

Description

technical field [0001] The invention belongs to the field of image processing, and specifically designs a fast recognition method for MA-YOLO dynamic gestures based on two-way segmentation. Background technique [0002] With the development of science and technology, computers have penetrated into the lives of ordinary people and are playing an increasingly important role in various fields. The current scientific research field pays more and more attention to the interaction with computers. In recent years, the rapid development of virtual reality technology has greatly improved human research enthusiasm. Existing research mainly focuses on recognizing facial expressions, mouths, detecting head orientation, tracking gaze, recognizing gestures and positioning techniques, and interpreting human postures. Various gestures are widely used in scientific fields and daily life, and gesture recognition has become a key research topic at present. At the same time, the academic com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/34G06K9/46G06K9/62G06N3/04
CPCG06V40/113G06V10/267G06V10/56G06N3/045G06F18/214
Inventor 项建弘李浩源陈振兴王聪蒋涵宇相豪乔立国臧笑魏晨马家辉
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products