Multi-view image fusion method and device, computer equipment, and storage medium

A fusion method and multi-view technology, applied in the field of image processing, can solve the problem of slow image processing speed and so on

Active Publication Date: 2018-11-16
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF9 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiment of the present invention provides a multi-viewpoint image fusion method, device, computer equipment an

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-view image fusion method and device, computer equipment, and storage medium
  • Multi-view image fusion method and device, computer equipment, and storage medium
  • Multi-view image fusion method and device, computer equipment, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] Embodiment 1 of the present invention provides a multi-view image fusion method. The method can be performed by a multi-view image fusion device, wherein the device can be implemented by software and / or hardware, and generally can be integrated in a computer device with a multi-view image fusion function, typically, can be integrated in a multi-camera smart terminal Or in a multi-view image acquisition device. figure 1 It is a schematic flowchart of a multi-view image fusion method provided in Embodiment 1 of the present invention, as shown in figure 1 As shown, the method includes:

[0028] S101. Acquire an image to be fused of a target object under a standard shooting angle of view and a reference image of the target object under a non-standard shooting angle of view.

[0029] In this embodiment, the image to be fused and the reference image of the target object can be collected and generated locally, or can be obtained from other devices. Considering the timelines...

Embodiment 2

[0042] figure 2 It is a schematic flowchart of a multi-view image fusion method provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the above embodiments. In this embodiment, "based on the sub-optical flow information, the The feature map to be fused and the reference image are fused to the image to be fused and the reference image to obtain the target image of the target object under the standard shooting angle of view. Correcting the angle of view of the feature map, so as to correct the reference feature map into a correction map under the standard shooting angle of view; according to the order of definition from small to large, sequentially fuse the feature map to be fused and the correction map under each definition, Obtain the target image of the target object under the standard shooting angle of view.

[0043] Further, before acquiring the image to be fused of the target object under the standard shooting angle of view and t...

Embodiment 3

[0067] Embodiment 3 of the present invention provides a multi-view image fusion device, which can be implemented by software and / or hardware, and generally can be integrated in a computer device with a multi-view image fusion function. Typically, it can be integrated in a multi-camera intelligent In the terminal or the multi-view image acquisition device, the multi-view image fusion method can be implemented to realize the fusion of the multi-view images. image 3 A structural block diagram of a multi-view image fusion device provided in Embodiment 3 of the present invention, as shown in image 3 As shown, the device includes:

[0068] An image acquisition module 301, configured to acquire an image to be fused of the target object under a standard shooting angle of view and a reference image of the target object under a non-standard shooting angle of view;

[0069] An optical flow information calculation module 302, configured to calculate the optical flow information between...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-view image fusion method and device, computer equipment, and a storage medium. The method includes the steps: acquiring a to-be-fused image of a target object at a standard shooting view angle and a reference image of the target object in a non-standard shooting view angle; calculating optical flow information between the to-be-fused image and the reference image; performing the fusion of the to-be-fused image and the reference image according to the optical flow information to obtain a target image of the target object in a standard shooting view angle. Throughemploying the above technical scheme, the method can improve the fusion speed of multi-view images, and reduce the manpower and material resources in the image fusion process.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a multi-view image fusion method, device, computer equipment and storage medium. Background technique [0002] In recent years, with the reduction of the cost of camera sensors, multi-camera, multi-camera and even dense array multi-view image acquisition devices have gradually become the mainstream trend of image acquisition. [0003] Multi-view image acquisition devices generally use image fusion synthesis algorithms to fuse the images collected at various shooting angles to generate images of the target scene. Therefore, compared with pictures collected by single-camera image acquisition devices, they have higher It has the advantages of high efficiency, low noise, and large amount of information. At present, the following challenges need to be faced when performing multi-view image fusion: there are parallax, occlusion, etc. between the pictures collected und...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N5/232G06T5/50
CPCG06T5/50H04N23/951
Inventor 方璐戴琼海郑海天
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products