Device and method for stabilizing video image sequence capable of doing multi-degree of freedom movement in real time

Abstract

The invention provides a device for stabilizing a video image sequence capable of doing multi-degree of freedom movement in real time. The device comprises a programmable logic device, a programmable logic device connecting analog-digital converter, a digital analog converter, two digital signal processors, an image sequence buffer, a parameter configuration static memory and an image sequence buffer. The invention further provides a method for stabilizing the video image sequence capable of doing the multi-degree freedom of movement in real time, an image sequence interframe epipole converting model is adopted, the accurate positions, where a feature point is located, on image frames are forecasted, the image sequence interframe multi-degree of freedom movement is drawn by establishing a video image forecast feature point set virtual curve family, the accurate position, where the forecast feature point is located, on a corresponding stabilizing image is obtained by utilizing the dimensionality reduction image data processing method, a constraint matrix is established, and a stable output video is obtained by reestablishing an output image. According to the device and method, an electronic stabilized image can be fast achieved in a high-precision mode, and the processing efficiency of the system is greatly improved.

Description

technical field [0001] The invention relates to a video image sequence real-time stabilization device and method supporting multi-degree-of-freedom motion, and belongs to the technical field of digital video processing. Background technique [0002] At present, with the needs of modern military technology and industrial development, the status of reconnaissance and surveillance intelligence in war, anti-terrorism, and anti-theft is becoming more and more prominent. Since the reconnaissance and surveillance field of view of the fixed-base imaging platform is affected by the field of view of the optical system and the environment, the ability of the imaging system to obtain information is limited. In order to make up for the lack of imaging platforms with fixed bases, countries around the world place reconnaissance and surveillance systems on mobile platforms (such as ground vehicles, ships, aircraft, satellites, etc.) to expand the dynamic field of view of the optical system ...

AI Technical Summary

Problems solved by technology

However, due to the introduction of a more complex image stabilization model, it will bring various defects to the hardware device for the realization of the algorithm

For example, the SFM (cross matrix) method is actually used to deal with nonlinear problems. It is a typical beam adjustment to solve the problem, and based on medium and large-scale tracking points and three-dimensional information processing, it will lead to a serious decrease in the efficiency of the algorithm and affect the performance of the system. real-time

At the same time, the mis-matching of feature points and when the change complexity of the video image scene is lower than the change required by the model, it is difficult to extract enough feature information, which will make it difficult for the image stabilization system to play its role, and even cause motion vector detection errors

In addition, small camera movements or approximate planar scene geometry (distant objects) also make it difficult to determine changes in 3D position

Images