Multispectral image panchromatic sharpening method and system based on spatial-spectral fusion network

A multi-spectral image, fusion network technology, applied in image enhancement, image analysis, graphic image conversion and other directions, can solve problems such as distortion and hyperspectral, and achieve the effect of improving utilization, stable fusion results, and improving information utilization.

Active Publication Date: 2021-07-02
SHANDONG NORMAL UNIV
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although these techniques accurately preserve spatial information, the PAN and MS components are often characterized by high spectral distortion since they are acquired in spectral ranges that only partially overlap

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multispectral image panchromatic sharpening method and system based on spatial-spectral fusion network
  • Multispectral image panchromatic sharpening method and system based on spatial-spectral fusion network
  • Multispectral image panchromatic sharpening method and system based on spatial-spectral fusion network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Such as figure 1 As shown, in order to solve the problems of spatial information ambiguity and spectral distortion in the prior art to improve the spatial resolution. This embodiment provides a multi-spectral image panchromatic sharpening method based on a spatial-spectral fusion network. This embodiment uses this method as an example to illustrate a server. It can be understood that this method can also be applied to a terminal, or The application includes terminals, servers and systems, and is realized through the interaction between terminals and servers. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or it can provide cloud services, cloud database, cloud computing, cloud function, cloud storage, network server, cloud communication, intermediate Cloud servers for basic cloud computing services such as software services, domain name services, security service CDN, and big data and ar...

Embodiment approach

[0049] As one or more implementations, before step (2), it includes: performing a quadruple upsampling operation on the low spatial resolution multispectral image to obtain a low spatial resolution image with the same size as the high spatial resolution panchromatic image P The initial multispectral image LM.

[0050] As one or more implementations, such as figure 2 As shown, step (4) includes:

[0051] Step (4-1): Input the multispectral image with low spatial resolution and the panchromatic image with high spatial resolution into the stacking module of the fusion network to obtain the first fusion feature map f 1 ;

[0052] Step (4-2): The first multispectral image feature map ms extracted by the first-level spectral information extraction network 1 , the first panchromatic image feature map pan extracted by the first-level spatial information extraction network 1 Input the first fusion block of the fusion network to calculate the first multispectral image feature map m...

Embodiment 2

[0096] This embodiment provides a multi-spectral image panchromatic sharpening system based on a spatial-spectral fusion network.

[0097] A multi-spectral image panchromatic sharpening system based on spatial-spectral fusion network, including:

[0098] An acquisition module configured to: acquire a low spatial resolution multispectral image and a high spatial resolution panchromatic image;

[0099] The spectral information extraction network module is configured to: perform information extraction step by step through the spectral information extraction network for multispectral images with low spatial resolution;

[0100] The spatial information extraction network module is configured to: extract the panchromatic image with high spatial resolution through the spatial information extraction network for step-by-step information extraction;

[0101] The fusion network module is configured to: average the multispectral image feature map extracted by each level of spectral infor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of image processing, and provides a multispectral image panchromatic sharpening method and system based on a spatial-spectral fusion network. The method comprises the following steps of: (1) acquiring a multispectral image with low spatial resolution and a panchromatic image with high spatial resolution; (2), carrying out step-by-step information extraction on the multi-spectral image with low spatial resolution through a spectral information extraction network; (3), carrying out step-by-step information extraction on the panchromatic image with the high spatial resolution through a spatial information extraction network; and (4) averaging the multispectral image feature map extracted by each stage of spectral information extraction network and the panchromatic image feature map extracted by each stage of spatial information extraction network, and carrying out stacking and convolution operation on the obtained average value and the feature map obtained by the fusion network layer by layer to finally obtain a high-spatial-resolution multispectral image.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a multispectral image panchromatic sharpening method and system based on a spatial spectrum fusion network. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] Multispectral images have been well used in environmental monitoring, mining and agriculture. Due to the hardware limitations of sensors, optical remote sensing satellites can usually only measure some low-resolution multispectral images (LRMS) and high-resolution panchromatic images (PAN). In general, grayscale panchromatic images are characterized by high spatial resolution and low spectral resolution, whereas color multispectral images have high spectral resolution but low spatial resolution. Image fusion technology can integrate spatial and spectral information int...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(China)
IPC IPC(8): G06T5/00G06T5/50G06T3/40G06N3/04G06N3/08
CPCG06T5/50G06T3/4053G06T3/4046G06N3/08G06T2207/20081G06T2207/20084G06T2207/10036G06T2207/10041G06T2207/20221G06N3/045G06T5/73
Inventor张凯王安飞张风李卓林盛志刁文秀
OwnerSHANDONG NORMAL UNIV