A video jitter removing method based on a fusion motion model

Abstract

The invention discloses a video jitter removal method based on a fusion motion model, and the method comprises the following steps: (1) calculating an optical flow between adjacent frames of a video,extracting feature points, and calculating a matching result; (2) performing three-dimensional reconstruction according to the matching result of the feature points, and recovering the three-dimensional camera pose of the camera and the three-dimensional point cloud of the scene; (3) establishing a grid-based two-dimensional motion model by the optical flow, and describing a deformation relationship between the two frames; (4) smoothing the motion estimation of the three-dimensional motion model, and solving the motion compensation of the grid model; (5) smoothly calculating a motion track based on the grid model, and solving motion compensation; And (6) drawing a stable image frame according to the obtained motion compensation. According to the method, the three-dimensional motion model and the two-dimensional motion model are fused, the visual effect and robustness of the video jitter removal algorithm are improved, the motion track is smoothed by using an optimization method, motioncompensation is solved, the video content is stabilized, and the watching experience is optimized.

Description

technical field

[0001] The invention relates to the fields of digital image processing and computer vision, in particular to a motion compensation method for image frames by smoothing motion trajectories and redrawing video frames to obtain stable and smooth visual effects. Background technique

[0002] With the development of the Internet and consumer electronics, video has become the main carrier for recording and sharing information, and the amount of video content shot anytime, anywhere using mobile devices has exploded, and videos shot with handheld devices are often not as smooth as professional equipment. lens trajectory, which results in a degraded viewing experience. So how to solve the problem of video jitter has become a research hotspot.

[0003] The digital image stabilization solution processes video content through algorithms, and consists of two parts: video motion estimation and motion smoothing. Motion estimation obtains the motion trajectory of the video...

Images