Unlock instant, AI-driven research and patent intelligence for your innovation.

Video stabilization method for simultaneously eliminating roller shutter artifacts and jitters

A technology of rolling shutter and video, applied in the direction of TV, color TV, color TV components, etc., can solve the problem of complex algorithm process and so on

Active Publication Date: 2020-06-30
NANJING UNIV OF SCI & TECH
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, both the robust mesh repair method and the subspace method are based on dealing with rolling artifacts or video jitter respectively, and the algorithm process is complex

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video stabilization method for simultaneously eliminating roller shutter artifacts and jitters
  • Video stabilization method for simultaneously eliminating roller shutter artifacts and jitters
  • Video stabilization method for simultaneously eliminating roller shutter artifacts and jitters

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] Aiming at the video shot by CMOS camera, the present invention realizes the effect of simultaneously removing rolling shutter artifact and jitter in the video, and proposes a joint optimization for simultaneously eliminating rolling shutter artifact and jitter by establishing an estimation model for inter-frame and intra-frame motion method. Combine below figure 1 , describe the implementation process of the present invention in detail:

[0048] Step 1, gridded video frame: Assume that the observed shaking video sequence containing rolling shutter artifacts is: {I t |t∈[1,N]}, where N represents the frame number of the video sequence, for each frame of video image, the definition form is 8×8 grid, then the tth frame I t The grid at row i and column j in can be expressed as And define the exposure time between adjacent grids under the same grid column as the unit time.

[0049] Step 2. Estimating inter-frame motion: Apply feature point detection to the grids corresp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video stabilization method for simultaneously eliminating roller shutter artifacts and jitter. The method comprises the following steps: 1) gridding video frames; 2) estimating inter-frame motion; 3) constructing a data fidelity term and a motion smoothing regular term; 4) constructing an inter-frame and intra-frame motion joint optimization model; 5) estimating intra-frame motion; 6) setting a self-adaptive sliding window; 7) calculating an adaptive weight; 8) solving restoration transformation; and 9) simultaneously removing roller shutter artifacts and stabilizingvideo generation. According to the method, each frame of a video is gridded, inter-frame motion is simulated by utilizing homography transformation, intra-frame motion is simulated by utilizing rigidity transformation, an inter-frame and intra-frame motion joint model is established, and roller shutter artifact and jitter removal recovery transformation is directly solved; the method can realize video roller shutter artifact removal and video stabilization at the same time, avoids the problem of over-smoothness in the video jitter removal process, and can be widely applied to stabilization ofvarious types of videos such as mobile phone shooting, unmanned aerial vehicle shooting and vehicle-mounted navigation which adopt CMOS cameras.

Description

technical field [0001] The invention relates to a shake video stabilization technology, in particular to a video stabilization method for simultaneously eliminating rolling shutter artifacts and shakes. Background technique [0002] In the field of video processing and display, video signals captured by CMOS cameras through vehicle-mounted camera platforms, drone or ship camera systems, and handheld camera equipment often have rolling artifacts due to the progressive imaging of cameras, and the shooting Random disturbances in the process can also easily cause video jitter. On the one hand, these video degradations can easily cause visual fatigue of video observers and affect the content understanding of video images, resulting in misjudgments or missed judgments by observers; Subsequent processing of the video, such as tracking, recognition and pattern analysis, etc. [0003] At present, there are already many methods for the separation of rolling shutter artifacts and vid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/232G06T5/00G06T7/246
CPCG06T7/246G06T2207/10016H04N23/681H04N23/689G06T5/77
Inventor 吴慧聪杨帆肖亮
Owner NANJING UNIV OF SCI & TECH