Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image stitching processing method, device and electronic system

A processing method and image mosaic technology, applied in the field of image processing, can solve problems affecting the effect of image mosaic and achieve the effect of improving the effect

Pending Publication Date: 2021-05-28
MEGVII BEIJINGTECH CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The current mainstream patchwork search method is based on the graph cut (graph cut) algorithm. This algorithm searches for the minimum energy path in the local area of ​​the image through the energy function defined by the difference in image pixel values. However, the energy of the local area is minimized. Important areas with insignificant differences (the area where there are significant targets, etc.) may also belong to the position where the energy is minimized, and then it is determined to be a seam, which affects the effect of subsequent image stitching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image stitching processing method, device and electronic system
  • Image stitching processing method, device and electronic system
  • Image stitching processing method, device and electronic system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] refer to figure 1 A schematic structural diagram of the electronic system 100 is shown. The electronic system can be used to implement the image mosaic processing method and device of the embodiments of the present invention.

[0042] Such as figure 1 A schematic structural diagram of an electronic system is shown, the electronic system 100 includes one or more processing devices 102, one or more storage devices 104, input devices 106, output devices 108 and one or more image acquisition devices 110, these components The interconnections are via bus system 112 and / or other forms of connection mechanisms (not shown). It should be noted that figure 1 The components and structures of the electronic system 100 shown are exemplary rather than limiting, and the electronic system may also have other components and structures as required.

[0043] The processing device 102 may be a server, an intelligent terminal, or a device including a central processing unit (CPU) or oth...

Embodiment 2

[0050] An embodiment of the present invention provides an image mosaic processing method, which can be applied to electronic equipment, and the electronic equipment can be configured with the above-mentioned electronic system, see figure 2 , the method mainly includes the following steps:

[0051] Step S202, acquiring a first overlapping image and a second overlapping image respectively corresponding to overlapping areas of the first image and the second image to be stitched.

[0052] The above image may be an image extracted from a video received by the image acquisition device, or may be an image obtained from a network or a third party. For example, the first image and the second image may be captured by cameras at different positions, and the types of cameras (telephoto camera, wide-angle camera, etc.) used to capture the two images may be the same or different. Since there is an overlapping area between the first image and the second image, and the information of this o...

Embodiment 3

[0069] On the basis of the second embodiment above, in order to improve the efficiency of image stitching, this embodiment optimizes the above step S204 (that is, the step of determining the fusion energy map corresponding to the first overlapping image and the second overlapping image), see image 3 A flow chart of another image mosaic processing method is shown, the method mainly includes the following steps:

[0070] Step S302, acquiring a first overlapping image and a second overlapping image respectively corresponding to overlapping areas of the first image and the second image to be stitched.

[0071] Step S304, determining a first edge energy map corresponding to the first overlapping image and a second edge energy map corresponding to the second overlapping image.

[0072] For the application scenario where the first overlapping image and the second overlapping image are both color images (such as RGB format, etc.), the color image can be grayscaled before performing e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image stitching processing method, a device, and an electronic system. The method comprises the steps of obtaining a first overlapping image and a second overlapping image corresponding to overlapping areas of a first image and a second image to be stitched respectively; determining a fusion energy diagram corresponding to the first overlapping image and the second overlapping image; determining a minimum energy path corresponding to the first graph edge to the second graph edge of the fused energy graph; determining a first mask corresponding to the first overlapping image and a second mask corresponding to the second overlapping image based on the minimum energy path; and stitching the first image and the second image based on the first mask and the second mask. According to the invention, the area through which the abutted seam passes is optimized to a certain extent, and the image splicing effect is improved.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to an image mosaic processing method, device and electronic system. Background technique [0002] The task of image stitching is to combine multiple images with overlapping fields of view to obtain high-resolution images with a large field of view. This leads to problems such as ghosting and object truncation in the splicing results. The impact of image content misalignment in overlapping areas on splicing can be alleviated to a certain extent by seam search. [0003] The current mainstream patchwork search method is based on the graph cut (graph cut) algorithm. This algorithm searches for the minimum energy path in the local area of ​​the image through the energy function defined by the difference in image pixel values. However, the energy of the local area is minimized. Important areas with insignificant differences (the area where there are significant targets,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40G06T5/50G06T7/11G06T7/13
CPCG06T3/4038G06T5/50G06T7/13G06T7/11G06T2207/20221G06T2207/20081
Inventor 刘伟舟胡晨周舒畅
Owner MEGVII BEIJINGTECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com