An efficient video stabilization method based on geometric interpolation

An efficient video and stabilization method technology, applied in the field of video processing, can solve problems such as high computational cost, poor robustness, inability to handle rapid camera motion, and severe occlusion in rapid scene transitions

Inactive Publication Date: 2016-01-27
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

3D methods can in principle handle the parallax problem and produce very stable results, but are less robust and computationally expensive
The 2.5D method does not require 3D reconstruction, which greatly reduces time consumption, but the long feature point trajectory required by the method also makes it unable to deal with some situations such as rapid camera movement, rapid scene change, severe occlusion, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An efficient video stabilization method based on geometric interpolation
  • An efficient video stabilization method based on geometric interpolation
  • An efficient video stabilization method based on geometric interpolation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0052] An efficient video stabilization method based on geometric interpolation, the specific implementation steps are as follows:

[0053] Step 1. Calculate the optimal smooth path

[0054]For jittery video, an optimal smooth path is calculated, each frame on the path is regarded as a stable frame without debounce operation, and all other frames are regarded as jittered frames. The method proposed by Neel, Joshi et al. (Joshi, N., Kienzle, W., Uyttendaele, M., and Cohen, M. Real-TimeHyperlapseCreationviaOptimalFrameSelection.ACMSIGGRAPH2015.) was used in the calculation. For each frame of the video, the frame matching cost is calculated with the subsequent W frames, and then a dynamic programming algorithm is used to calculate a path with the least cost starting from a certain frame in the first g frame of the video to the end of a certain frame in the last g frame. . The frame matching cost in the NeelJoshi method is defined as follows:

[0055] Item 1: Alignment cost

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an efficient video stabilization method based on geometric interpolation and belongs to the technical field of video processing. The method comprises the steps of calculating an optimal smooth path according to the interframe matching cost; dividing video into a plurality of sections with frames on the optical smooth path as the boundaries and performing motion estimation on each section according to feature point detection and matching; with the start frame and the termination frame of each section as the reference, calculating the motion compensation of other frames through the linear interpolation method for geometrical quantities; generating stable video after image transformation of shaking frames through motion compensation transformation. Compared with conventional methods, the method describes camera motion through interframe affine transformation, obtains the translation compensation and rotation compensation of shaking frames through linear interpolation of geometrical quantities, guarantees that generated stable images are free of obvious warp, and is high in calculation efficiency and robustness.

Description

technical field [0001] The invention relates to a video stabilization method, in particular to an efficient video stabilization method based on geometric interpolation, and belongs to the technical field of video processing. Background technique [0002] Video shooting has important applications in media entertainment, urban security, etc. However, due to the limitations of the hardware environment and the level of the shooting personnel during video shooting, the video shot in the motion environment often has problems such as image shake, which affects the further processing of the video. [0003] Scholars at home and abroad have done a lot of basic research on video stabilization, which has high application value. Commonly used video stabilization methods mainly include three categories: methods based on estimating and smoothing 2D camera motion, methods based on estimating and smoothing 3D camera motion, and 2.5D methods combining the advantages of the former two. Metho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/21
Inventor 张磊陈晓权黄华
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products