Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Grid-optimization-based registration method for panoramic image splicing

An image registration, panoramic image technology, applied in image analysis, image data processing, graphic image conversion and other directions, can solve the problems of stitching failure, distortion, resolution reduction, etc., to achieve the effect of superior stability

Active Publication Date: 2019-09-06
FUDAN UNIV
View PDF6 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to obtain wide-angle images, the traditional method is to use a wide-angle lens, such as a fisheye lens, which can capture nearly 180 degrees of the entire scene on the horizontal plane, but this method has at least the following three shortcomings: First, it will introduce distortion visible to the naked eye and distortion, the second is that the resolution is reduced due to the large shooting angle, and the third is that the wide-angle lens is expensive
A homography matrix can only align one plane, if there is parallax and stretching in the original image, very severe ghosting and tilting will appear in the mosaic obtained by using traditional methods, and even the mosaic will fail (the resulting image is completely distorted)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Grid-optimization-based registration method for panoramic image splicing
  • Grid-optimization-based registration method for panoramic image splicing
  • Grid-optimization-based registration method for panoramic image splicing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] Below by example, further describe the method of the present invention in conjunction with accompanying drawing.

[0049] For a group of test image sequences A, use the method of the present invention to carry out image registration, the specific process is as follows:

[0050] 1. Use the ORB algorithm to perform fast feature extraction on each image in A, and obtain the feature points of each image;

[0051] 2. Introduce the K-D tree in the rough matching of feature points. Since the descriptor of each feature point is a 256-bit binary string, it can be used as 32-dimensional data, with 8 bits per dimension. It is applied to the K-D tree construction, and then found based on BBF search The points closest to this feature point are used as a pair of matching points;

[0052] 3. Apply ratio test and cross test to the obtained matching point pairs, eliminate the wrong matches, and keep the remaining ones as fine matching point pairs;

[0053] 4. Perform multi-layer RANAC...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of digital images, and particularly relates to a grid-optimization-based registration method suitable for free view angle image splicing. In recent years,due to the application prospect in the fields of virtual reality, medical imaging and the like, the panoramic image is greatly concerned. The image registration is mainly used for obtaining position parameters of each image in a panorama. Traditional image registration needs to execute a series of operations such as feature point extraction, matching, homography matrix solving and camera parametercorrection. According to the grid-optimization-based registration method, a grid optimization-based registration method is used for replacing a classic registration technology, so that the speed is obviously improved, and the grid-optimization-based registration method is suitable for splicing images with large parallax shot at a free visual angle. According to the grid-optimization-based registration method, ORB rapid feature extraction is used for obtaining feature points of an image, and a strategy of step-by-step coarse and fine matching is introduced, and finally, three constraint termsbased on grid optimization are introduced, and an error function minimization method is used for obtaining optimal registration parameters between the images.

Description

technical field [0001] The invention belongs to the technical field of digital image processing, and in particular relates to an image registration method based on grid optimization for panorama image mosaic. Background technique [0002] With the rapid development of information technology and the improvement of people's living standards, people's demand for high-quality panoramic images is also increasing. Whether it is virtual reality, panoramic live broadcast, medical imaging, or assisted driving, panoramic images are very good. application prospects. Functionally, people can get more information from panoramic images and get a better visual experience. [0003] In order to obtain wide-angle images, the traditional method is to use a wide-angle lens, such as a fisheye lens, which can capture nearly 180 degrees of the entire scene on the horizontal plane, but this method has at least the following three shortcomings: First, it will introduce distortion visible to the nak...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40G06T7/30
CPCG06T3/4038G06T7/30Y02T10/40
Inventor 范益波周思远杨吉喆孟子皓池俊曾晓洋
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products