Electronic image stabilization method based on inertial navigation information

Abstract

The invention provides an electronic image stabilization method based on inertial navigation information. The method comprises the following steps that: firstly, feature points of each image of a video are extracted, subsequently the overall motion estimation is carried out on two adjacent frames by using a feature point matching algorithm; if the overall motion estimation has larger errors, the overall motion is estimated by using motion information obtained by an inertial navigation system so as to compensate the errors caused by the fact that the overall motion is estimated by merely using an image; the overall motion estimation adopts an affine transformation model; then motion filtering is carried out on the model in combination with the image and the inertial navigation information so as to distinguish the active motion and a trembling component of a camera; and moreover, a rotational component introduced because of the trembling is determined; and furthermore an original video image is compensated by using the obtained trembling and rotational components so as to obtain a stable video; and the image restoration treatment is carried out on each frame of image of the video in combination with the image information and the inertial navigation prediction motion information. The method needs no complex hardware and is good in electronic image stabilization; and the calculation precision is improved.

Description

technical field [0001] The invention relates to the field of digital signal processing, in particular to an electronic image stabilization method based on inertial navigation information. Background technique [0002] During the shooting process of the camera, if the camera is not fixed on a stable tripod or other fixtures, the captured image will shake. For example: during the flight of an aircraft, due to the turbulence affected by the airflow, the image captured by the airborne visible light or infrared sensor shakes; It will also cause the captured image to be very unstable; in the process of shooting with a hand-held camera, shaking of the captured image due to shaking of the human hand will affect the viewing quality of the captured video. Due to this random jitter, the target to be focused on in the image shakes back and forth in the display window, which will cause the observer to feel fatigued, resulting in misjudgment and missed judgment, and will also bring diffi...

AI Technical Summary

Problems solved by technology

However, traditional electronic image stabilization also has a big technical bottleneck. Traditional electronic image stabilization methods simply use image information to stabilize the captured video images. However, due to the complexity of the scene, the image stabilization will fail.

Images