Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Full-frame electronic image stabilization method based on feature matching

A feature matching and electronic image stabilization technology, which is applied in the field of image processing, can solve the problems of high complexity of feature extraction process, difficulty in hardware real-time implementation, and prone to mismatching, so as to improve observation effect, facilitate hardware real-time implementation, and enhance robustness. sticky effect

Inactive Publication Date: 2016-08-17
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF2 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention aims to solve the problem that the feature extraction process of the existing electronic image stabilization method based on feature matching is relatively complex, it is difficult to implement in real time by hardware, the feature matching process is prone to mis-match, and the parameter estimation process is robust to mis-match and foreground moving objects Poor, motion compensation forms an undefined area in the output frame, which affects the visual effect, and a full-frame electronic image stabilization method based on feature matching is proposed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Full-frame electronic image stabilization method based on feature matching
  • Full-frame electronic image stabilization method based on feature matching
  • Full-frame electronic image stabilization method based on feature matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention is described in further detail below:

[0035] like figure 1 As shown, a full-frame electronic image stabilization method based on feature matching in the present invention mainly includes the following four processes: feature point extraction, feature point matching, motion parameter estimation, and stable full-frame output.

[0036] (1) Feature point extraction

[0037] Using the ORB feature descriptor (Rublee, Ethan, et al."ORB: an efficient alternative to SIFTor SURF."Computer Vision (ICCV), 2011IEEE International Conference on.IEEE, 2011.), each frame in the video sequence is Extract feature points.

[0038] In order to facilitate the real-time hardware implementation of this process, the present invention quantizes the direction angle of the feature point by 2π / 32 (11.25 degrees) according to the size relationship of the first-order moment of the feature point neighborhood, and establishes a fast lookup table. At the same time, according t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a full-frame electronic image stabilization method based on feature matching, which belongs to the technical field of digital image processing and aims at eliminating influences on a video sequence by jitter such as camera translation and rotation and generating stable full-frame video output. The method comprises steps: firstly, an ORB feature descriptor is adopted to extract feature points in each frame, a two-level matching strategy with minimum and second minimum Hamming distance ratio judgment in combination with coordinate and direction angle difference test is used for matching feature points in adjacent frames; then, a motion parameter estimation method with triangle area similarity test in combination with RANSAC is used for estimating and accumulating inter-frame affine transformation parameters; and finally, an image mosaic technique is used for acquiring a motion compensation mosaic image, subjective motion parameters of the camera are estimated through Kalman filtering, a display window with the same size as the video frame is set on the mosaic image sequentially, and complete motion compensation frame output is obtained. Translation and rotation jitter in the original video sequence are effectively removed, and the stable full-frame output is obtained.

Description

technical field [0001] The invention belongs to the technical field of image processing, relates to the stabilization processing of video sequences, in particular to an electronic image stabilization method based on feature matching. Background technique [0002] When the digital camera is in use, due to the vibration of the carrier platform, the output video has translation and rotation jitter, which greatly affects the observation effect of the video, and also reduces the performance of video monitoring and encoding. As an effective video image stabilization method, electronic image stabilization technology has the characteristics of high precision, low power consumption and low cost, and has been widely used in military and civilian applications. [0003] Commonly used electronic image stabilization methods can be roughly divided into two types based on block matching and feature matching. The image stabilization method based on block matching divides the image into many...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/232
Inventor 李佳男许廷发张坤
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products