Hyperspectral open set classification method based on self-supervised learning and multi-task learning

A multi-task learning and supervised learning technology, applied in neural learning methods, instruments, biological neural network models, etc., can solve problems such as the inability to fully improve the network fitting ability and robustness.

Active Publication Date: 2021-09-14
XIDIAN UNIV
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method does not make full use of the rich information of unlabeled data in the hyperspectral ope

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hyperspectral open set classification method based on self-supervised learning and multi-task learning
  • Hyperspectral open set classification method based on self-supervised learning and multi-task learning
  • Hyperspectral open set classification method based on self-supervised learning and multi-task learning

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0027] Examples of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0028] refer to figure 1 , the implementation steps of this example include the following:

[0029] Step 1, acquire hyperspectral images and perform normalization processing.

[0030] 1.1) Download a 3D hyperspectral image X∈R from the Internet m×n×b and the corresponding label graph Y ∈ R m×n , where R represents the real number field symbol, m represents the number of row pixels of X and Y, n represents the number of column pixels of X and Y, and b represents the number of bands of the hyperspectral image;

[0031] 1.2) Normalize the pixels belonging to each known category in the acquired three-dimensional hyperspectral image X by the following formula:

[0032]

[0033] where x i,j,d Represents a two-dimensional image X on the dth spectral band in image X d ∈ R m×n The value of the i-th row and j-th column pixel on the i∈[1,m], j∈[1,n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hyperspectral open set classification method based on self-supervised learning and multi-task learning, which mainly solves the problem of low classification precision caused by the fact that an existing hyperspectral open set classification method cannot fully utilize unlabeled samples of a hyperspectral open set, and the implementation scheme of the hyperspectral open set classification method comprises the following steps: inputting a hyperspectral image and preprocessing the hyperspectral image; performing neighborhood block taking on the preprocessed image to generate a training data set and a test data set; constructing a neural network model based on self-supervised learning and multi-task learning; training the constructed neural network model by utilizing the training data set and adopting a self-supervised learning method and a multi-task learning method; and inputting the test data set into the trained neural network model to obtain a classification result. According to the method, label-free sample information can be fully utilized, the problem that label samples are few is solved, the classification precision is improved, and the method can be applied to environment monitoring, resource exploration, urban planning and agricultural planning.

Description

technical field [0001] The invention belongs to the technical field of image processing, and further relates to a hyperspectral open set classification method, which can be applied to environmental monitoring, resource exploration, urban planning and agricultural planning. Background technique [0002] Hyperspectral records the continuous spectral characteristics of ground objects with its rich band information, and can perform more types of ground object recognition and higher-precision target classification. Recently, with the wide application of deep learning in various fields, a variety of deep learning classification methods have emerged in the field of hyperspectral image classification, such as autoencoders, convolutional neural networks, and deep belief networks. Moreover, the proposal of the deep learning classification method with unknown class recognition ability also alleviates the problem that the traditional hyperspectral image classification method cannot iden...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/24G06F18/214Y02A40/10
Inventor 慕彩红刘逸孙庆虎王蓉芳冯婕刘若辰
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products