Video significance processing method based on spectral analysis

Abstract

The invention relates to a video significance processing method based on spectral analysis. The method comprises the following steps of: extracting a key frame from an input video by utilizing a method for extracting a video key frame according to motion information to acquire a video key frame sequence; extracting a video key frame gray level image sequence and a video key frame motion information characteristic map sequence; calculating Renyi entropy of the video key frame gray level image sequence and the video key frame motion information characteristic map sequence; measuring the distribution of significance points in the air domain significant maps by the Renyi entropy and using a result as a significant value of an air domain significant map; and finally linearly fusing the obvious vale of the video key frame air domain significant value and an obvious value of the time domain so as to acquire an overall obvious value of the video key frame. By the method, the significance information carried by magnitude spectra and phase spectrum in the video key frame field is fully utilized, the calculated amount is small and the effect is prominent; and the distribution of the significance points in the significant maps is measured by the Renyi entropy, and the result is used as the significant value of the significant pattern, so that the problem of overall significance measurement of the significant maps are well solved; and therefore, the method can be applied to video analysis processing systems of various of military use or civil use.

Description

technical field [0001] The invention relates to a video saliency processing method based on frequency spectrum analysis, which can be applied to various military or civilian video analysis and processing systems. Background technique [0002] The development of digital imaging technology has brought us rich video resources, but it also brought a sharp increase in the amount of video data and how to deal with it effectively. Video saliency analysis technology can help people quickly find interesting content from a large amount of visual information, ignore secondary content, and reduce the calculation amount of information processing. It is one of the ways to effectively process massive video data. [0003] There are many traditional video saliency calculation models, but most of these models rely on the specific characteristics of the video scene, the models are complex, the calculation is heavy, and the versatility is not strong. Recently, a video saliency calculation mode...

AI Technical Summary

Problems solved by technology

[0003] There are many traditional video saliency calculation models, but most of these models rely on the specific characteristics of the video scene, the models are complex, the calculation is heavy, and the versatility is not strong

Recently, a video saliency calculation model based on spectrum analysis has also been proposed. These models do not rely on specific features, have strong versatility, and have a small amount of calculation. However, they often only consider one aspect of the amplitude spectrum or phase spectrum in the spectrum, and Video saliency is usually given in the form of a saliency map of video frames, which is inconvenient to apply

Images