Dual-channel infrared behavior identification method based on attitude profile and motion information

A technology of motion information and recognition methods, applied in the fields of image processing and computer vision, can solve problems such as failure to function normally, poor lighting, etc., and achieve the effect of suppressing background interference and improving accuracy

Inactive Publication Date: 2018-05-11
CHONGQING UNIV OF POSTS & TELECOMM
View PDF5 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Visible light monitoring cannot function normally in many situations, such as poor lighting, rain, fog and other weather conditions.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dual-channel infrared behavior identification method based on attitude profile and motion information
  • Dual-channel infrared behavior identification method based on attitude profile and motion information
  • Dual-channel infrared behavior identification method based on attitude profile and motion information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0041] In the present invention, the original infrared video sequence is firstly divided into a motion information channel and a posture shape channel, and in the motion information channel, optical flow features are extracted from the original infrared video sequence to obtain a corresponding optical flow image sequence, and the optical flow image sequence Input the C3D network Ⅰ, and extract the features of the second fully connected layer of the network as the feature vector Ⅰ. Then in the attitude profile channel, the original infrared image is estimated for attitude, and the human skeleton sequence diagram is obtained. Use Gaussian filtering to process the human skeleton sequence graph, smooth the edges of the graph to obtain the corresponding pose feature map, and then input it into the C3D network II to extract the features of the se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a dual-channel infrared behavior identification method based on attitude profile and motion information. The method comprises the following steps of: S1, in a motion information channel, extracting variation optical flow characteristics of an original infrared image sequence, and obtaining an optical flow image sequence; S2: dividing the optical flow image sequenceinto a training set and a test set, and after fine tuning of a C3D network, extracting network characteristics; S3: in an attitude profile channel, performing attribute estimation of an infrared image, and extracting a human body skeleton diagram; S4: performing Gaussian smoothing of the human body skeleton diagram, and obtaining an attitude characteristic graph; S5: dividing the attitude characteristic graph into training test sets, and after fine tuning of the C3D network, extracting network characteristics; S6: performing early-stage fusion of the characteristics of the two networks, and obtaining final characteristics; and S7: employing an SVM classifier to perform classification identification of the final characteristics to obtain an identification result. The dual-channel infraredbehavior identification method based on attitude profile and motion information comprehensively employs video information to take the attitude characteristic graph as more effective profile information on the space and improve the identification result so as to provide a technical support for subsequent research.

Description

technical field [0001] The invention belongs to the technical field of image processing and computer vision, and relates to a dual-channel infrared behavior recognition method based on gesture shape and motion information. Background technique [0002] Behavior recognition has been a research hotspot in the field of computer vision in recent years, and it has been widely used in intelligent monitoring, human-computer interaction, virtual reality and other fields. In the field of visible light, the development of behavior recognition has matured. In the infrared field, due to the high price of early infrared equipment, the application in the civilian field has not been popularized, resulting in a lag in the development of behavior recognition in the infrared field. In recent years, as the cost of infrared imaging equipment decreases, the use of infrared equipment will gradually become popular. [0003] Behavior recognition involves the following types of research methods: t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/20G06V40/10G06F18/2411G06F18/253
Inventor 高陈强王灿杜莲冯琦汪澜
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap