Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-focus image fusion method based on multi-scale feature interaction network

A multi-focus image, multi-scale feature technology, applied in the field of multi-focus image fusion, to achieve the effect of improving accuracy, accurate detection, and avoiding information loss

Active Publication Date: 2021-11-26
HEFEI UNIV OF TECH
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, inaccurate detection of object boundaries may introduce undesirable artifacts around them

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-focus image fusion method based on multi-scale feature interaction network
  • Multi-focus image fusion method based on multi-scale feature interaction network
  • Multi-focus image fusion method based on multi-scale feature interaction network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0075] In this embodiment, a multi-focus image fusion method based on a multi-scale feature interaction network, the specific process is as follows figure 1 shown, including the following steps:

[0076] Step 1. Data preparation;

[0077] Acquire any pair of multi-focus images I with a resolution of H×W×3 and complementary focus areas A and I B ;

[0078] Acquire an image with multifocus I A A binary image G with a resolution of H×W corresponding to the middle focus area 1 , and perform N-1 regional interpolation and downsampling to obtain a set of binary image sets denoted as {G 1 ,G 2 ,...,G n ,...,G N}, and as a reference image for network training, where G n Represents the reference image of the nth scale, N represents the number of scales;

[0079] In this example, the multi-focus images are synthesized using the original clear images with segmentation labels in the PASCAL VOC 2012 dataset; the size of the original clear images is adjusted to 240×240×3, and the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-focus image fusion method based on a multi-scale feature interaction network. The method comprises the following steps: 1, performing channel connection on a pair of color multi-focus source images, and inputting the color multi-focus source images into the designed multi-scale feature interaction network (MSFIN) to generate a focus image representing pixel focus attributes; 2, binarizing the focused image (namely setting a pixel value higher than a threshold value as 1, and otherwise, marking the pixel value as 0) to obtain an initial decision diagram, and refining the initial decision diagram by adopting a full-connection conditional random field (FC-CRF) to remove some misclassified small regions to obtain a final decision diagram; and 3, based on the refined final decision diagram, adopting a pixel weighted average strategy to obtain a fused image. The images with different focus areas can be effectively fused, a new solution is provided for fusion of the multi-focus images, the fused image contains enhanced spatial information, and information transmission and image processing are facilitated.

Description

technical field [0001] The invention belongs to the technical field of multi-focus image fusion, and in particular relates to a multi-focus image fusion method based on a multi-scale feature interaction network. Background technique [0002] With the rapid development of sensor and computer technology, digital image, as a product of these new technologies, has gradually penetrated into people's lives and become one of the main sources of information for human beings. Therefore, enriching the information content of the image and improving the visual effect of the image can lay a good foundation for subsequent image processing. Due to the limited depth of field of the optical lens, it is difficult for the camera to clearly capture all the objects in the same scene. Specifically, objects within the depth of field (DOF) are quickly captured, while other objects outside the depth of field (DOF) are blurred. Multi-focus image fusion technology can fuse multiple images of the sam...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/241G06F18/253
Inventor 刘羽王磊成娟李畅宋仁成陈勋
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products