Video interaction event analysis method and device based on sequence space-time cube features

Abstract

The present invention relates to a video interaction event analysis method and device based on sequence space-time cube features. The method includes: dividing the surveillance video into several space-time cube sequences based on the detection and tracking results of the surveillance video; extracting object trajectories in each space-time cube , appearance and local motion descriptors, and the extracted descriptors are composed of feature fragments; all feature fragments in the space-time cube are reconstructed to construct sequence space-time cube features, and the sequence space-time cube features are used to classify and detect interaction events. The device includes a preprocessing module, a video sequence division module, a space-time cube feature extraction module, a time series feature reconstruction module and a sequence feature classification module. The invention realizes the high-level semantic layer description of the monitoring video content, and uses the multi-core support vector machine based on the dynamic time alignment kernel function to realize the variable-length sequence feature classification, thereby realizing the intelligent detection of the interactive event of the monitoring video stream.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and relates to a monitoring video interaction event analysis method, in particular to a monitoring video interaction event analysis method based on sequence space-time cube characteristics, and a device for realizing the method. Background technique [0002] As surveillance cameras are widely used in all aspects of people's lives, surveillance video data is growing explosively. How to intelligently analyze interesting events that occur in it is a challenging problem. Among the events of interest, some are multi-object interaction events, such as fights, robberies, homicides, and car crashes. In order to be able to report to the police in the early stage of the incident and assist in the investigation and evidence collection after the incident, the intelligent analysis method for such incidents is very critical. [0003] At present, the handling of such incidents mainly relies on witnesse...

AI Technical Summary

Problems solved by technology

This analysis method lacks the description of the local motion characteristics of the object, and cannot determine the specific type of a complex event by analyzing the causal relationship between each stage of the complex event.

Images