Spatial spectrum attention hyperspectral image classification method based on Octave convolution

A technology of hyperspectral image and classification method, which is applied in the field of spatial spectral attention hyperspectral image classification based on Octave convolution, can solve the problems of disappearing network training gradient, poor robustness, and large distance between the same categories, and achieves hyperspectral image classification. The information contained in the features is comprehensive and detailed, the classification accuracy is improved, and the feature representation is enhanced.

Active Publication Date: 2019-11-29
XIDIAN UNIV
View PDF4 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The deep residual convolutional neural network effectively solves the problem that the features extracted by the image classification task contain insufficient information and the network training gradient disappears. However, this network still has large distances between the same category and small distances between different categories due to the complexity of the image data. , the problem of low image classification accuracy and the low robustness of the network caused by the small number of training samples, and the problem of easy to fall into overfitting
[0004]Although the existing convolutional neural network can achieve the task of hyperspectral pixel-level classification, there are still three deficiencies in learning image semantic information: one is Due to the inaccurate positioning of classification information caused by the complexity of hyperspectral images, the distance between the same category is large and the distance between different categories is small when performing classification tasks; the second is that when extracting hyperspectral features, the utilization rate of the extracted features is insufficient It causes information loss or retains too much irrelevant information, resulting in information redundancy, which affects the classification results. At the same time, the convolutional neural network often falls into the local optimal area during training; the third is that there are relatively few hyperspectral data available, and the training convolutional neural network A large amount of training data is usually required, and a small amount of hyperspectral data cannot meet the data requirements of convolutional neural networks
These three deficiencies will lead to problems of poor robustness and misclassification in the classification process of actual hyperspectral images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spatial spectrum attention hyperspectral image classification method based on Octave convolution
  • Spatial spectrum attention hyperspectral image classification method based on Octave convolution
  • Spatial spectrum attention hyperspectral image classification method based on Octave convolution

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] In recent decades, high spectral resolution has provided useful information for distinguishing different materials and objects. Hyperspectral image classification methods have been widely used in Earth observation, especially in urban development, precision agriculture, land change detection, and resources. Management and other aspects are of great significance. Among the existing methods of hyperspectral image classification, see figure 1 After constructing the hyperspectral image library, dividing the training sample set and the test sample set, building and training the convolutional neural network model, and testing the trained convolutional neural network model, the classification of the hyperspectral image is completed, but due to the hyperspectral image The complexity of the image leads to inaccurate positioning of classification information, and the trained network is easy to fall into the problem of local optimization; at the same time, due to the deep network d...

Embodiment 2

[0045] The hyperspectral image classification method based on the space spectrum attention mechanism deep learning of Octave convolution is the same as in embodiment 1. The Octave convolutional neural network described in step (3) of the present invention is constructed, see figure 2 , The present invention composes the Octave convolution module, spatial attention module, spectral attention module, pixel-level attention module and fully connected layer of the Octave convolutional neural network. The parameters of each component module are set as follows:

[0046] The Octave convolution module is the input module, which consists of four convolution parts connected in sequence, and each convolution part includes Octave convolution, see Figure 4 , Batch Normalization and Relu activation functions, there is also a maximum pooling layer between the second and third convolutional parts.

[0047] The Octave convolution operation mainly divides the hyperspectral image into two parts: the h...

Embodiment 3

[0054] The hyperspectral image classification method based on the space spectrum attention mechanism of Octave convolution is the same as that in Example 1-2, and the loss function loss of Octave convolutional neural network is determined in step 4 op , Specifically including the following steps:

[0055] (4a) The training image library (T 1 ,T 2 ,...,T j ,...,T M } Input to the Octave convolution module of the Octave convolutional neural network, and output the last layer feature F of the convolution layer.

[0056] (4b) Input the last layer of feature F to the spatial attention module and spectral attention module of the Octave convolutional neural network, and the output features are A and B respectively, and then input the output features A and B to the pixel-level attention module , The output characteristics are C and D respectively.

[0057] (4c) Input the obtained features C and D into the fully connected layer of the Octave convolutional neural network, and output the output...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a spatial spectrum attention hyperspectral image classification method based on Octave convolution, and solves the problems of large class spacing, small different class spacing and low classification accuracy in the prior art. The scheme is as follows: inputting images to be classified and preprocessing data, dividing a training set and a test set, constructing an Octave convolutional neural network, determining a loss function of the Octave convolutional neural network, training and updating the Octave convolutional neural network, testing the data of the test set, and completing hyperspectral image classification. According to the method, Octave convolution operation is used to reinforce feature representation, and a spatial attention mechanism and a spectral attention mechanism are introduced, so that the network can more accurately find an area which is more beneficial to classification and contains more comprehensive and detailed information. The method ishigh in classification precision and strong in robustness, and can be applied to analysis and management of hyperspectral image data.

Description

Technical field [0001] The invention belongs to the technical field of image processing, and particularly relates to the content classification of hyperspectral images. Specifically, it is a spatial spectrum attention hyperspectral image classification method based on Octave convolution, which can be applied to the analysis and management of hyperspectral image data. Background technique [0002] With the continuous improvement of the pixel resolution of hyperspectral images, more useful data and information can be obtained from hyperspectral images. According to the needs of different applications, the processing of hyperspectral images also has different requirements. Therefore, in order to effectively analyze and manage these hyperspectral image data, it is necessary to attach a semantic label to each pixel of the hyperspectral image. The classification of hyperspectral images is an important way to solve such problems. Hyperspectral image classification refers to distinguish...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V20/13G06V20/194G06N3/045G06F18/24Y02A40/10
Inventor 唐旭孟凡波马晶晶焦李成
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products