Video keyframe extraction method based on linear dynamic system

Abstract

The invention discloses a video keyframe extraction method based on a linear dynamic system. The method comprises the steps of (1), collecting a video data file to be processed; (2), initializing a video segment, calculating linear dynamic system model parameters of the video segment, and calculating the reconstruction error of the video segment according to the model parameters; (3), increasing the length of the video segment frame by frame, and repeating the step (2) till the reconstruction error is beyond a pre-set threshold value; (4), taking the finally determined middle frame of the video segment as the keyframe of the segment; and (5), initializing the next new video segment after the previous video segment, and repeating the steps (2)-(3) till the video data file is ended. By means of the video keyframe extraction method based on the linear dynamic system disclosed by the invention, the description capability of keyframes in semantic contents can be obviously improved; and thus, the video keyframe extraction method can be applied in the services, such as internet video content retrieval, sensitive video detection and filtering and intelligent video monitoring.

Description

technical field [0001] The invention relates to the technical field of image processing and computer application, in particular to a video key frame extraction method based on a linear dynamic system. Background technique [0002] With the rapid development of multimedia technology and Internet technology, multimedia data represented by video is growing at an alarming rate. For example, monitoring systems for security are installed in banks, airports, residential areas and other areas, which generate a large amount of monitoring video data every day; Growing rapidly. How to quickly locate, facilitate access and effectively manage the useful information contained in such massive video data is an urgent problem to be solved. The essence of this problem is how to use computer technology to effectively analyze and express video content, so that it can establish contextual information and related domain knowledge, so as to integrate various clues for reasoning, and establish th...

AI Technical Summary

Problems solved by technology

The biggest disadvantage of this type of method is that the amount of calculation is relatively large; 4. Based on the method of motion analysis, this type of method first calculates the optical flow of each frame, then calculates the motion matrix through the optical flow, and finally analyzes the matrix as a time function and select keyframes

This type of method is very dependent on local information, so the robustness is not strong; 5. The method based on the statistical characteristics of MPEG macroblocks. This type of method uses the difference in the encoding method of macroblocks in the frame to generate frame differences, and extracts key points by measuring frame differences. frame, this type of method does not need to decompress the video, and can perform real-time key frame extraction, but there is not much information that can be used in the compressed domain, and the key frame extraction is not accurate enough

To sum up, these methods currently hardly consider how to use the apparent information and motion information in video clips in key frame extraction, nor do they consider adaptive key frame sampling methods.

Images