Full-frame electronic image stabilization method based on feature matching

Abstract

The invention discloses a full-frame electronic image stabilization method based on feature matching, which belongs to the technical field of digital image processing and aims at eliminating influences on a video sequence by jitter such as camera translation and rotation and generating stable full-frame video output. The method comprises steps: firstly, an ORB feature descriptor is adopted to extract feature points in each frame, a two-level matching strategy with minimum and second minimum Hamming distance ratio judgment in combination with coordinate and direction angle difference test is used for matching feature points in adjacent frames; then, a motion parameter estimation method with triangle area similarity test in combination with RANSAC is used for estimating and accumulating inter-frame affine transformation parameters; and finally, an image mosaic technique is used for acquiring a motion compensation mosaic image, subjective motion parameters of the camera are estimated through Kalman filtering, a display window with the same size as the video frame is set on the mosaic image sequentially, and complete motion compensation frame output is obtained. Translation and rotation jitter in the original video sequence are effectively removed, and the stable full-frame output is obtained.

Description

technical field [0001] The invention belongs to the technical field of image processing, relates to the stabilization processing of video sequences, in particular to an electronic image stabilization method based on feature matching. Background technique [0002] When the digital camera is in use, due to the vibration of the carrier platform, the output video has translation and rotation jitter, which greatly affects the observation effect of the video, and also reduces the performance of video monitoring and encoding. As an effective video image stabilization method, electronic image stabilization technology has the characteristics of high precision, low power consumption and low cost, and has been widely used in military and civilian applications. [0003] Commonly used electronic image stabilization methods can be roughly divided into two types based on block matching and feature matching. The image stabilization method based on block matching divides the image into many...

AI Technical Summary

Problems solved by technology

[0005] The present invention aims to solve the problem that the feature extraction process of the existing electronic image stabilization method based on feature matching is relatively complex, it is difficult to implement in real time by hardware, the feature matching process is prone to mis-match, and the parameter estimation process is robust to mis-match and foreground moving objects Poor, motion compensation forms an undefined area in the output frame, which affects the visual effect, and a full-frame electronic image stabilization method based on feature matching is proposed

Images