A low-latency video image stabilization method based on inertial navigation parameter manifold optimization

A video image stabilization and low-latency technology, applied in the field of video processing, can solve the problems of poor image stabilization effect and high delay of video image stabilization algorithm

Active Publication Date: 2020-07-07
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to propose a low-latency video image stabilization method based on inertial navigation parameter manifold optimization for the problems of high delay and poor image stabilization effect of existing video image stabilization algorithms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A low-latency video image stabilization method based on inertial navigation parameter manifold optimization
  • A low-latency video image stabilization method based on inertial navigation parameter manifold optimization
  • A low-latency video image stabilization method based on inertial navigation parameter manifold optimization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046]Attached below figure 1 The embodiment of the method of the present invention is described in detail.

[0047] A low-latency video image stabilization method based on inertial navigation parameter manifold optimization, the specific implementation steps of the present invention are as follows:

[0048] Step A, obtaining inertial navigation parameters;

[0049] In this embodiment, the data interface of the mobile device iphone with the inertial navigation sensor is used to extract the inertial navigation parameters while shooting the video. The parameters are the rotational angular velocity of the mobile device around the three coordinate axes in the camera coordinate system. Here, the frame rate of the video is set to 30fp, and the sampling frequency of the inertial navigation parameters is 30 times per second; using this parameter to model the motion of the moving device can obtain a more accurate motion trajectory, which has a positive impact on the video image stabil...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a low-delay video image stabilization method based on inertial navigation parameter manifold optimization, and belongs to the technical field of video processing. The method includes the following steps: obtaining the inertial navigation parameters of the mobile device, calculating the rotation matrix of the rigid body transformation of the mobile device in the camera coordinate system according to the parameters, expressing the sequence of the rotation matrix as a Lie group manifold composed of rigid body transformations, and then passing The Kalman filter smooths the rigid body transformation sequence, and finally performs motion compensation transformation on the video frame through projection to obtain a stable video. Compared with the existing methods, this method directly obtains the motion parameters of the mobile device, avoids a large number of calculations in motion estimation and the dependence on the video shooting scene; and integrates the motion smoothing part into the Kalman filter algorithm of the Lie group manifold, The calculation efficiency is improved, the calculation time is saved, and low-latency image stabilization processing is realized.

Description

technical field [0001] The invention relates to a video image stabilization method, in particular to a low-delay video image stabilization method based on manifold optimization of inertial navigation parameters (referred to as inertial navigation parameters), and belongs to the technical field of video processing. Background technique [0002] With the development of electronic technology, the popularity of video capture devices such as mobile phones and cameras is getting higher and higher. The light weight and cheapness of electronic equipment make video shooting an important part of people's entertainment life. However, the quality of portable video capture equipment is relatively light, and the operator will inevitably shake it. In addition, amateurs lack stable equipment such as tripods and pan-tilts. Therefore, when shooting, the camera will shake to a certain extent, resulting in inaccurate video data collected. Stablize. Unstable video not only has a greater impact...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/232G06T7/277G06T5/00G06T3/60
CPCG06T3/60G06T5/002G06T7/277G06T2207/10016H04N23/68H04N23/687
Inventor 黄华杨佳丽张磊
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products