Dual-channel infrared behavior identification method based on attitude profile and motion information

Abstract

The present invention relates to a dual-channel infrared behavior identification method based on attitude profile and motion information. The method comprises the following steps of: S1, in a motion information channel, extracting variation optical flow characteristics of an original infrared image sequence, and obtaining an optical flow image sequence; S2: dividing the optical flow image sequenceinto a training set and a test set, and after fine tuning of a C3D network, extracting network characteristics; S3: in an attitude profile channel, performing attribute estimation of an infrared image, and extracting a human body skeleton diagram; S4: performing Gaussian smoothing of the human body skeleton diagram, and obtaining an attitude characteristic graph; S5: dividing the attitude characteristic graph into training test sets, and after fine tuning of the C3D network, extracting network characteristics; S6: performing early-stage fusion of the characteristics of the two networks, and obtaining final characteristics; and S7: employing an SVM classifier to perform classification identification of the final characteristics to obtain an identification result. The dual-channel infraredbehavior identification method based on attitude profile and motion information comprehensively employs video information to take the attitude characteristic graph as more effective profile information on the space and improve the identification result so as to provide a technical support for subsequent research.

Description

technical field [0001] The invention belongs to the technical field of image processing and computer vision, and relates to a dual-channel infrared behavior recognition method based on gesture shape and motion information. Background technique [0002] Behavior recognition has been a research hotspot in the field of computer vision in recent years, and it has been widely used in intelligent monitoring, human-computer interaction, virtual reality and other fields. In the field of visible light, the development of behavior recognition has matured. In the infrared field, due to the high price of early infrared equipment, the application in the civilian field has not been popularized, resulting in a lag in the development of behavior recognition in the infrared field. In recent years, as the cost of infrared imaging equipment decreases, the use of infrared equipment will gradually become popular. [0003] Behavior recognition involves the following types of research methods: t...

AI Technical Summary

Problems solved by technology

Visible light monitoring cannot function normally in many situations, such as poor lighting, rain, fog and other weather conditions.

Images