Unlock instant, AI-driven research and patent intelligence for your innovation.

Human body behavior spatio-temporal conjoint analysis method based on cellular automaton idea

A technology of cellular automata and joint analysis, applied in neural learning methods, computer components, instruments, etc., can solve problems such as large computing power requirements, high equipment requirements, and poor timeliness of detection

Pending Publication Date: 2022-07-29
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But at the same time, the detection of the two-dimensional human skeleton model will have errors in many cases, and the extracted key points will also be blocked due to a specific action in the three-dimensional space where the target is located. Behavioral analysis of the results of the results has a considerable impact, making its judgments based on the continuity of the image error
Although there are 3D skeleton and bone key point extraction technologies nowadays, compared with the 2D skeleton and bone key point extraction technology, the environmental information in 3D space is geometrically increased compared with the environmental information in 2D space, and the current three-dimensional The more accurate methods of human body pose estimation have higher requirements on equipment, such as motion capture and other methods
This has led to the fact that although the accuracy of 3D human pose estimation is significantly higher than that of 2D, the disadvantages are that the research cost is high, the demand for computing power is large, and the timeliness of detection in complex environments is not good. Extraction occupies an important position in the human behavior recognition monitoring system, and its effectiveness has a significant impact on the results of subsequent behavior recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body behavior spatio-temporal conjoint analysis method based on cellular automaton idea
  • Human body behavior spatio-temporal conjoint analysis method based on cellular automaton idea
  • Human body behavior spatio-temporal conjoint analysis method based on cellular automaton idea

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The technical solution of the invention is described in detail below in conjunction with the accompanying drawings:

[0027] In one embodiment, as Figure 5 As shown, a spatiotemporal joint analysis method of human behavior based on the idea of ​​cellular automata is provided, which includes the following steps:

[0028] (1) Use the optical gait capture technology of the infrared camera to obtain the key point model of the 3D skeletal posture of the human body, and establish a 3D coordinate system in the projection space of the infrared camera where the key point model of the 3D skeleton posture of the human body is located. Discretization of skeleton pose key points in the 3D skeleton pose key point model of the human body;

[0029] (2) Define the energy value function of the key points of the human skeleton posture in the three-dimensional skeleton posture key point model of the human body and the smooth value function of the energy change value function of the key p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a cellular automaton idea-based human body behavior spatio-temporal conjoint analysis method. The method comprises the following steps of: discretizing obtained three-dimensional skeleton posture key points of a human body based on the cellular automaton idea; secondly, energy smooth values of the human body three-dimensional skeleton posture key points are calculated in combination with the energy values of the human body three-dimensional skeleton posture key points and position changes of the human body skeleton key points; and finally, constructing a human body spatio-temporal conjoint analysis deep network, and inputting the three-dimensional coordinate information extracted from the human body falling video frame by frame and the calculated smooth value of the energy change after the key change of the human body into the constructed human body behavior spatio-temporal conjoint analysis network for training so as to carry out human body posture detection. According to the method, a behavior analysis technology in the field of machine vision is simplified from complex environment human body image recognition processing to simple conditions of coordinates of human body three-dimensional skeleton key points and energy changes of the human body skeleton key points, computer computing power required by behavior analysis is reduced, and the method has a wide application scene.

Description

technical field [0001] The invention belongs to the field of attitude detection in the field of machine vision, and in particular relates to a spatiotemporal joint analysis method of human behavior based on the idea of ​​cellular automata. Background technique [0002] The research content of human pose recognition is a human pose restoration method composed of fixed joint points obtained from the observation of images. Human posture detection needs to locate the key nodes of the human body in a complex and changing environment. The focus of human body recognition includes human body detection and key point location. Deep learning and human pose estimation technology are developing rapidly today, and the research on human behavior analysis has also received extensive attention. Related researchers have proposed a large number of human pose detection methods. [0003] In today's target-specific behavior analysis, most researchers directly process the data of two-dimensional ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06V40/20G06V10/82G06N3/04G06N3/08G06T17/00
CPCG06T17/00G06N3/049G06N3/08G06N3/045
Inventor 张晖夏望舒赵海涛朱洪波
Owner NANJING UNIV OF POSTS & TELECOMM