Transfer learning-based hyperspectral image super-resolution method

A hyperspectral image and transfer learning technology, applied in neural learning methods, instruments, biological neural network models, etc., can solve the problems of inability to train deep neural networks, limited spatial resolution of hyperspectral images, and too little training data for hyperspectral images and other problems to achieve the effect of low complexity, good effect and strong anti-noise performance

Inactive Publication Date: 2017-10-27
XI'AN INST OF OPTICS & FINE MECHANICS - CHINESE ACAD OF SCI
View PDF5 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to address the deficiencies of the above-mentioned existing methods, and propose a hyperspectral image super-resolution method based on migration learning, which can solve the problem that the original hyperspectral image training data is too small and cannot train a deep neural network, and improve hyperspectral image quality. The spatial discrimination of images can overcome the problem of limited spatial resolution of hyperspectral images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transfer learning-based hyperspectral image super-resolution method
  • Transfer learning-based hyperspectral image super-resolution method
  • Transfer learning-based hyperspectral image super-resolution method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The invention makes full use of the powerful migration learning ability of the deep convolutional network, and transfers the mapping relationship from the low-resolution image to the high-resolution image in the natural image database to the hyperspectral image, so as to realize the super-resolution of the hyperspectral image.

[0032] (1) Firstly, the convolutional neural network is trained on the natural image database, and the mapping relationship between low-resolution images and high-resolution images is learned. Suppose the low-resolution image of natural image is X S , and the corresponding high-resolution image is Y S . Using the low-resolution images and corresponding high-resolution images in the natural image library, train the convolutional neural network to obtain the mapping f() from the low-resolution image to the high-resolution image. Among them, the low-resolution image X S Is the input of the convolutional neural network, the high-resolution image ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a transfer learning-based hyperspectral image super-resolution method, which mainly solves the problem that a deep neural network cannot be trained due to excessively less training data of an original hyperspectral image, improves spatial identification of the hyperspectral image, and solves the problem of spatial resolution limitation of the hyperspectral image. The method mainly comprises the steps of (1) training a convolutional neural network in a natural image database, and learning a mapping relationship between a low-resolution image to a high-resolution image; (2) on a tested hyperspectral image, generating the corresponding high-resolution image waveband by waveband according to the learnt deep neural network; (3) establishing co-matrix decomposition and performing same ground object restriction on the low-high-resolution images; and (4) reconstructing a super-resolution hyperspectral image. According to the method, spectral information of the super-resolution image is kept to the maximum extent; and the method can be used in the fields of remote sensing ground object observation, military reconnaissance, assistance in criminal investigation and the like.

Description

technical field [0001] The invention belongs to the technical field of image processing, in particular to a hyperspectral image super-resolution method. Background technique [0002] With the development of remote sensing technology and imaging spectrometers, the application of hyperspectral remote sensing images is becoming more and more extensive. Hyperspectral remote sensing images have many spectral bands, which sacrifice spatial resolution for high spectral resolution. difficulty. For example, the spatial resolution of the image is low, and the visual recognition is low, resulting in a serious mixture of ground objects, that is, there are pixels mixed with various types of ground objects. It can be said that the spatial resolution has become the main limiting factor for the application effect of hyperspectral images. Therefore, it is very necessary to improve the resolution of the hyperspectral image and enhance the recognition of the objects in the image while keepi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/08
CPCG06N3/084G06V20/13G06F18/214
Inventor 卢孝强袁媛郑向涛
Owner XI'AN INST OF OPTICS & FINE MECHANICS - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products