Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Panorama image stitching method and device

A panoramic image and image technology, applied in the field of image processing, can solve problems such as image registration failure, splicing error image distortion, and reduced image distortion generation rate

Inactive Publication Date: 2016-03-09
HUAWEI TECH CO LTD
View PDF2 Cites 59 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] But this stitching method can only be applied to images taken under the condition of pure rotation of the camera
If the camera is not purely rotated, when a displacement occurs, a global homography matrix cannot register the image, and a stitching error will cause the stitching result image to be distorted
[0006] There is no effective splicing method in the prior art that can process multiple images well when the camera is not purely rotated and has displacement, so that the rate of spliced ​​image distortion is reduced

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Panorama image stitching method and device
  • Panorama image stitching method and device
  • Panorama image stitching method and device

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0391] The two images of the collected desktop are as follows: Figure 6a As shown, the splicing results of the prior art are as follows Figure 6b As shown, the splicing result obtained by using the scheme provided by the embodiment of the present invention is as follows Figure 6c shown, from Figure 6b and Figure 6c It can be seen that the curve is better, so the registration error of the technical solution provided by the embodiment of the present invention is smaller, and the quality of the splicing result is higher.

example 2

[0393] Using a wide-angle lens, 15 images were collected by pure rotation, such as Figure 7a shown. There is no parallax between the 15 images, but the wide-angle lens will produce radial distortion, and the stitching algorithm provided by the existing technology has a large error in processing, such as Figure 7b As shown, especially the tallest building in 7b, the result of the spelling is tilted to the left, resulting in distortion. Using the solution provided by the embodiment of the present invention, a closed-loop constraint item is added to the global energy function, so that the content at the beginning and the end are stitched together, and image distortion is avoided, and the quality of the stitching result is higher, as shown in Figure 7c shown.

example 3

[0395] 24 images of the globe were collected along the equator, such as Figure 8a As shown, the parallax between images is large, and the scene is non-planar. The splicing result obtained by using the splicing method provided by the prior art is as follows: Figure 8b As shown, it can be seen that the complete stitching of the 24 images cannot be performed. Using the scheme provided by the embodiment of the present invention, the 24 images can be spliced ​​into a complete image, such as Figure 8c As shown, the quality of the stitching results is relatively high.

[0396] Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer prog...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the invention provides a panorama image stitching method and device which can perform good processing on a plurality of images when a camera is in non-pure rotation and displacement exists, and can allow the distortion generation rate of stitched images to be reduced. The method includes the following steps of: designing a homographic matrix according to local areas of various feature points in various images; using the designed homographic matrix to detect the feature points and delete the wrong feature points; performing meshing processing on the images; constructing a global energy function based on mesh vertices and various feature points after the wrong feature points are deleted; solving the optimized mesh vertices; performing coordinate transformation on pixel points of various images based on the optimized mesh vertices; and performing stitching processing on various images by using various transformed pixel points.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a panoramic image stitching method and device. Background technique [0002] With the rise of handheld devices such as digital cameras and smartphones, taking and sharing photos has become increasingly convenient and has gradually become an important entertainment in our lives. Because the angle of view of a single camera is limited, many camera programs provide a panorama shooting mode, which guides the user to take multiple photos, and then automatically synthesizes a large-angle panorama. Under the condition of pure rotation of the camera, all input images come from the same viewpoint. After a lot of research, there are already relatively mature models and solutions, which have also been widely used in practice. [0003] However, in the process of using a handheld device, it is actually difficult to guarantee shooting with a single viewpoint, that is, it is d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/50G06T3/40
Inventor 陈子冲章国锋鲍虎军何轶
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products