A transformer-based behavior analysis method, device and terminal equipment thereof

A behavior analysis and human image technology, applied in the field of image recognition technology research, can solve the problems of limited accuracy, only considering global features, time-consuming and labor-intensive, etc., to achieve the effect of improving accuracy and close connection

Active Publication Date: 2021-09-28
NANJING SHICHAZHE INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of realizing the present invention, the inventors found that there are at least the following problems in the prior art: behavior recognition technology includes data analysis and image recognition, data analysis relies on sensing instruments to collect multiple specific indicators of the target, and comprehensively outputs results based on numerical statistics. This type of method is time-consuming and labor-intensive, and has limited accuracy. Most of the existing image recognition methods are based on deep learning technology, using a single convolutional neural network to extract behavioral features, only considering global features, and insufficient expression of local features.
Some deep learning methods take into account local information and incorporate attention mechanisms, but the fusion method of local features and global features is relatively simple, the feature fusion is not comprehensive enough, and the expression ability is not strong enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A transformer-based behavior analysis method, device and terminal equipment thereof
  • A transformer-based behavior analysis method, device and terminal equipment thereof
  • A transformer-based behavior analysis method, device and terminal equipment thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to clarify the technical solution and working principle of the present invention, the embodiments of the present disclosure will be further described in detail below in conjunction with the accompanying drawings. All the above optional technical solutions may be combined in any way to form optional embodiments of the present disclosure, which will not be repeated here.

[0026] The first aspect: the embodiment of the present disclosure provides a transformer-based behavior analysis method, figure 1 It is a schematic structural diagram of a preprocessing module provided by an embodiment of the present disclosure, figure 2 A frame diagram of a transformer provided by an embodiment of the present disclosure; image 3 It is a schematic structural diagram of a polymorphic fusion module provided by an embodiment of the present disclosure. Combining these three images, the method mainly includes the following steps:

[0027] Step 1, split the human body image int...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a transformer-based behavior analysis method, device and terminal equipment thereof. The method includes: step 1, splitting a human body image into multiple limb parts through a preprocessing module, and step 2, expanding each sub-block into a Dimension vector, as the input of the transformer model, the transformer model includes an encoder and a decoder; step 3, optimize the sub-block through the polymorphic fusion module and enhance the global information at the same time to obtain the behavior category label. The present invention makes the link between target local and local, local and global closer, enables the model to focus on subtle actions, greatly improves the accuracy of behavior recognition, and thus achieves the purpose of precise early warning of dangerous behavior.

Description

technical field [0001] The present invention relates to the field of image recognition technology research, especially neural network, and in particular to a transformer-based behavior analysis method, device and terminal equipment. Background technique [0002] With the vigorous promotion of smart cities, the smart social governance system is gradually improving, and the mediation of social conflicts, as an important part of social governance, has also attracted much attention. In conflict mediation, due to the different education levels and personal qualities of the parties themselves, their performance in the mediation process is also different. Some parties are too excited and may have physical conflicts. This not only hinders the normal work order, but also affects The legitimate rights and interests of other masses have greatly affected the construction and development of a harmonious society. Therefore, it is particularly important to analyze the behavior of the part...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/103G06N3/047G06N3/048G06N3/045G06F18/2415G06F18/241
Inventor 姜峰周金明
Owner NANJING SHICHAZHE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products