A Human Behavior Recognition Method Based on Double-layer Conditional Random Field

A conditional random field and recognition method technology, applied in character and pattern recognition, computer components, instruments, etc., can solve the problems of high-order correlation, low recognition accuracy and joint distribution modeling that have not considered the potential structure of human behavior state at the same time Complicated issues

Active Publication Date: 2019-10-01
NANJING UNIV OF POSTS & TELECOMM
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The obvious shortcoming of the generative model is that when there are complex correlations between the input sample data, the modeling of the joint distribution will become complicated or even inaccurate
However, the above-mentioned existing behavior recognition methods based on probabilistic graphical models have not considered both the internal potential structure of the human behavior state and the high-order correlation between human behavior states, and there is still the problem of low recognition accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Human Behavior Recognition Method Based on Double-layer Conditional Random Field
  • A Human Behavior Recognition Method Based on Double-layer Conditional Random Field
  • A Human Behavior Recognition Method Based on Double-layer Conditional Random Field

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Below in conjunction with accompanying drawing, technical scheme of the present invention is described in further detail:

[0043] In order to solve the problems raised in the background technology, the present invention introduces a double-layer conditional random field model (DL-CRFs), which simultaneously captures the latent structure inside the human behavior state and the high-order Correlation.

[0044] Such as figure 1 Shown is the flow chart schematic diagram of the human behavior recognition method based on double-layer conditional random field of the present invention:

[0045] Step A, obtaining RGB-D training video samples containing human behavior RGB video information and depth information, and dividing each training video sample into a plurality of continuous video segments.

[0046] Step B, feature extraction: use OpenNI to extract the human body skeleton structure information of the subject of the action from the acquired depth information. Combining ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human body behavior recognition method based on a double-layer conditional random field, which belongs to the field of computer vision behavior recognition. Firstly, the human body posture of the action subject in the RGB-D video and the information features of the objects that may interact with it are extracted respectively, and the score information of each small video obtained by the interactive objects after the RGB-D video segmentation is calculated as the global feature. Then, the top-level conditional random field is modeled to capture the high-order correlation between human behaviors, the bottom-level conditional random field is modeled to enrich the underlying structure of human behavior, and finally a discriminant classification model of two-layer conditional random field is constructed. Next, exact inference and a structured support vector machine classifier are used to learn the discriminative classification model parameters for a two-layer conditional random field. Finally, predict the human behavior category in the test video according to the learned model parameters and the obtained model. The invention improves the recognition accuracy of human behaviors to a certain extent.

Description

technical field [0001] The invention relates to the technical field of computer vision action recognition, in particular to a human action recognition method based on double-layer conditional random fields (Double-layer conditional random fields model for human action recognition, DL-CRFs). Background technique [0002] Human behavior recognition in video sequences is a research topic involving computer vision, pattern recognition and artificial intelligence. It has been a hot research topic because of its wide application value in business, medical and sports fields. [0003] Literature [Koppula H S, Gupta R, Saxena A. Learning Human Activities and Object Affordances from RGB-D Videos [J]. International Journal of Robotics Research, 2013, 32 (8): 951-970.] according to the complexity of human behavior Behaviors are divided into high-level activities and simple actions. Simple behavior refers to an indivisible behavior with at most one interactive object in the process, and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/23G06F18/2411G06F18/29G06F18/214
Inventor 刘天亮董晓栋戴修斌高尚罗杰波
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products