Image fusion method based on convolutional neural network

Abstract

The invention discloses an image fusion method based on a convolutional neural network. The method comprises the following steps: collecting a training data set; constructing an image fusion model based on a convolutional neural network, and training to obtain the image fusion model; and inputting two images to be fused into the image fusion model to complete image fusion. According to the method, image registration and image fusion processes are trained in one network, and encoders are shared, so that network parameters are reduced, and the training process of the network is accelerated; meanwhile, a DenseBlock structure is designed, so that the feature extraction process is more accurate and reliable; and finally, by adopting a registration decoder network and a jump connection mode, a deformation field which is finally output by the network can capture feature information of a shallow network and can be fused with features of a deep network. Therefore, the method provided by the invention is high in reliability, good in practicability and relatively good in accuracy.

Description

technical field [0001] The invention belongs to the field of image processing, and in particular relates to an image fusion method based on a convolutional neural network. Background technique [0002] With the development of economy and technology, image processing technology has been widely used. In image processing, image fusion is often involved. After image fusion, the fused image can not only maintain the important information in the original image, but also reflect the transformation of the information of the newly added image; therefore, the fused image often combines complementary information and redundant information from multiple images. Information can provide richer data information. [0003] At present, with the popularity of artificial intelligence algorithms, artificial intelligence algorithms (such as convolutional neural network algorithms) have also been widely used in the field of image fusion. However, the current image fusion technology based on arti...

AI Technical Summary

Problems solved by technology

However, it is obvious that the existing image fusion technology based on artificial intelligence algorithm has a relatively cumbersome training process, and its reliability and accuracy are not high.

Images