A behavior recognition method, device and terminal equipment

A recognition method and behavior technology, applied in the field of behavior recognition, can solve the problem of low recognition accuracy, and achieve the effect of improving the accuracy, overcoming locality and one-sidedness, and avoiding inaccurate behavior recognition.

Active Publication Date: 2022-02-01
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the embodiment of the present invention provides a behavior recognition method, device and terminal equipment to solve the problem of low accuracy of behavior recognition in a single mode such as the existing RGB mode or depth mode

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A behavior recognition method, device and terminal equipment
  • A behavior recognition method, device and terminal equipment
  • A behavior recognition method, device and terminal equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0042] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude one or more other Presence or addition of features, wholes, steps, operations, elements, components and / or collections thereof.

[0043] It should...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention is applicable to the field of behavior recognition, and provides a behavior recognition method, device, and terminal equipment. By acquiring the RGB video stream and the depth video stream of the behavior to be detected, and then performing bidirectional compression and sorting on the two based on the sorting relationship of the video frames, Then input the image corresponding to the RGB video stream and the image corresponding to the depth video obtained by bidirectional compression and sorting into the first convolutional neural network and the second convolutional neural network to obtain the corresponding behavior prediction results, and then predict the results according to the behavior Determine the final behavior prediction result of the behavior to be detected, and determine the final behavior prediction result according to the behavior prediction results obtained by bidirectional compression and sorting, which overcomes the locality and one-sidedness in the learning process of RGB video streams and depth video stream sequences. The complementarity of the two well avoids the problem of inaccurate behavior recognition caused by external factors caused by a single modality, and greatly improves the accuracy of behavior recognition.

Description

technical field [0001] The invention belongs to the technical field of behavior recognition, and in particular relates to a behavior recognition method, device and terminal equipment. Background technique [0002] As an important research branch of computer vision, human behavior recognition has been widely used in video surveillance, video analysis, human-computer interaction and so on. [0003] At present, the actual application scenarios of human behavior recognition are becoming more and more complex, and the precision and accuracy of human behavior recognition are getting higher and higher. The traditional manual feature design method can no longer meet the needs of recognition accuracy in practical applications. Although the emergence of deep learning methods has improved the accuracy of behavior recognition, for a single modality (RGB mode or depth mode), the performance of behavior recognition will be reduced due to external factors such as background clutter, occlud...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/20G06V20/40G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/20G06V20/46G06V20/41G06N3/045G06F18/2411
Inventor 任子良程俊张锲石高向阳
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap