Hyperspectral image super-resolution processing method based on a convolutional network

A hyperspectral image and convolutional network technology, applied in the field of image super-resolution processing, can solve problems that affect the resolution of high-resolution images, do not take into account the information of high-resolution/low-resolution image blocks, and do not take into account model uncertainty factors, etc. , to achieve the effect of increasing the resolution

Active Publication Date: 2019-04-12
XIDIAN UNIV
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are still deficiencies: this method does not take into account the hidden variables hidden in the model, thus affecting the resolution of the generated high-resolution images
However, there are still shortcomings: this method uses a shallow probability model and only uses the information on the surface of the low-resolution image, and does not take into account the hidden information in the high-resolution / low-resolution image block pair. Therefore, more information cannot be generated to improve the resolution of the image, which affects the resolution of the final generated high-resolution image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hyperspectral image super-resolution processing method based on a convolutional network
  • Hyperspectral image super-resolution processing method based on a convolutional network
  • Hyperspectral image super-resolution processing method based on a convolutional network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the accompanying drawings.

[0028] refer to figure 1 , The specific implementation steps of the present invention are as follows.

[0029] Step 1. Image acquisition, generate samples.

[0030] (1a) Obtain a low-resolution hyperspectral image L and a high-resolution multispectral image H from the Harvard image set;

[0031] (1b) The low-resolution hyperspectral image L and the high-resolution multispectral image H are used as training samples, and the low-resolution hyperspectral image L and high-resolution multispectral image H that are different from the training samples are used as test samples.

[0032] Step 2. Build a convolutional network.

[0033] (2a) Set up the inference sub-network, which is composed of the input as Hidden variable is A variational autoencoder network composed of two convolutional neural networks CNN, where Represents the i-th pixel of the low-resolution hypersp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hyperspectral image super-resolution processing method based on a convolutional network, mainly solves the problem that a hyperspectral image generated in the prior art is low in resolution, and adopts the implementation scheme that firstly, a training sample and a test sample are formed by an acquired low-resolution hyperspectral image and a high-resolution multispectralimage; then constructing a convolutional network composed of an inference sub-network and a generation sub-network; training the convolutional network by using the training sample, and obtaining theconvolutional network with the highest similarity between the approximate distribution and the real distribution by maximizing a joint likelihood function of the low-resolution hyperspectral image andthe high-resolution multispectral image; and finally, inputting the test sample into the trained convolutional network, and carrying out optimization processing on the generated high-resolution hyperspectral image to obtain a final high-resolution hyperspectral image. According to the method, the resolution of generating the high-resolution hyperspectral image is improved by utilizing the deep convolutional neural network, and the method can be used for medical diagnosis, remote sensing, computer vision and monitoring.

Description

technical field [0001] The invention belongs to the technical field of image processing, and further relates to an image super-resolution processing method, which can be used in medical diagnosis, remote sensing, computer vision and monitoring. Background technique [0002] Super-resolution optical images can overcome the limitations of low-resolution optical images and have shown promising results in many applications such as medical diagnosis, remote sensing, computer vision, and surveillance. To obtain high-resolution optical images, the most direct way is to use high-resolution image sensors, but due to the limitations of the manufacturing process and cost of sensors and optical devices, it is difficult to achieve in many occasions and large-scale deployment. Therefore, it is of great practical significance to obtain high-resolution images through super-resolution technology using existing equipment. In order to break the limitation of the inherent resolution of the ima...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06N3/08G06T3/4053G06N3/045
Inventor 陈渤刘莹王正珏
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products