Multi-level deep recursion network group behavior identification method based on context

A recognition method and context technology, applied in character and pattern recognition, biological neural network models, instruments, etc., can solve the problem that the behavior recognition method does not provide a scalable method for high-level context modeling, etc., to achieve linear expansion and flexibility Effect

Inactive Publication Date: 2018-11-13
SHANGHAI JIAO TONG UNIV
View PDF2 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This is very helpful to solve the situation where the characteristics of the input instance are variable (for example, the number of characters in the group is different or the number of groups is different), and the linear expansio...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-level deep recursion network group behavior identification method based on context
  • Multi-level deep recursion network group behavior identification method based on context
  • Multi-level deep recursion network group behavior identification method based on context

Examples

Experimental program
Comparison scheme
Effect test

specific example

[0109] In this specific example, two databases, Collective Activity Dataset and Choi’s New Dataset, are selected for experiments to observe the matching effect of the present invention. And compare with the best existing methods, and analyze the experimental results. Because the widely used data set lacks sufficient background diversity and enough training data, it is sometimes possible to infer what happened in the image by classifying the background of the image. In order to avoid the influence of the background and focus on the analysis of the interaction, the method proposed by the present invention ignores the background information and does not use it in any step.

[0110] CollectiveActivity Dataset is widely used to evaluate group behavior recognition performance. The data set contains 44 video clips obtained by using a low-resolution handheld camera. There are eight character pose tags, five character-level action tags, and five group-level activities in this data set. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-level deep recursion network group behavior identification method based on context. The method comprises the following steps: step S1, encoding sub-action information through a binaryzation encoder based on the context, thereby forming single dynamic information; step S2, serving the movement locus of the human produced by using a human body detection and tracking method as the single individual locus, dividing all single individual locus into the human body group with time-space consistency, and establishing a single interaction model by using the single dynamic information so as to perform modelling on the human body group internal interaction and the interaction between the human body groups; and step S3, training the proposed multi-level recursion context encoding network so as to learn the features of the single dynamic information, the human body group internal interaction and the interaction between the human body groups. The method proposed by the invention is effective for identifying the group behavior, has robustness for the human body detection under the complex environment, and has enough high flexibility to simulate the high-order interaction context situation.

Description

Technical field [0001] The invention relates to a method in the technical field of group behavior recognition, in particular to a context-based multi-level deep recurrent neural network group behavior recognition method. Background technique [0002] High-level interactive context modeling, such as group interaction, is the core of group behavior recognition. However, most of the previous behavior recognition methods do not provide a flexible and extensible method to solve high-level context modeling problems. [0003] Group behavior recognition provides useful information for many practical applications including role understanding in the scene and event prediction. The main challenge of group behavior recognition is to model the interactive context information in the crowd. This is because the number of characters included in a scene often varies. In addition, in most cases, group behavior is related to several sub-interaction scenarios, so how to model the interaction between...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V20/53G06N3/045G06F18/214
Inventor 倪冰冰王敏思徐奕杨小康
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products