Hyperspectral classification method combining graph structure and convolutional neural network

A technology of convolutional neural network and hyperspectral classification, which is applied in the field of hyperspectral image classification to achieve the effects of improving classification accuracy, improving adaptability and suppressing noise

Pending Publication Date: 2022-01-11
中国人民解放军火箭军工程大学
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The basic idea of ​​the present invention is: firstly, a hyperspectral image multi-feature fusion network combining graph network and convolutional neural network is proposed. Extracting multi-scale spatial features from hyperspectral images not only solves the problem of superpixel HSI feature extraction, but also integrates the two networks of graph network and convolutional neural network, and then proposes a dual-core convolutional neural network for extracting from superpixel HSI. Extract multi-scale local features of pixels, and finally, introduce cascade operation to fuse multi-scale features of four branches

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hyperspectral classification method combining graph structure and convolutional neural network
  • Hyperspectral classification method combining graph structure and convolutional neural network
  • Hyperspectral classification method combining graph structure and convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Now in conjunction with accompanying drawing, specific embodiment of the present invention is described in further detail as follows:

[0054] The experiment of the present invention uses GeForce GTX 1080Ti 11G GPU and 3.70G Intel i9-10900K CPU on the computer, and trains the present invention in pytorch 1.8. The invention is used for classification on Pavia University, Salinas and Houston 2013 datasets.

[0055] First of all, the original hyperspectral image is segmented by superpixels to extract the spectral features of each superpixel block; then a multi-scale graph with superpixels as nodes is constructed; then the graph network is used to extract features from the multi-scale graph, The product neural network is used to extract the spectral features; finally, the features are fused, and the image features are interpreted by using the cross-entropy loss to obtain the label of each pixel and predict the node.

[0056] The method of the present invention mainly inclu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a hyperspectral image classification method combining a graph structure and a convolutional neural network. The convolutional neural network can decompose three dimensions into one-dimensional and two-dimensional convolutional neural networks, and the superpixel graph network can be used for subsequent multi-scale two-dimensional processing; the method comprises five steps of hyperspectral image segmentation and spectral feature extraction, multi-scale feature extraction based on a graph network, multi-scale feature extraction based on a convolutional neural network, feature fusion and pixel classification, and loss function and model training. Compared with the prior art, the invention provides a novel multi-scale fusion network and a spectral transformation mechanism, the graphic features and local pixel features based on multi-scale superpixels can be extracted, and the spectral features of graph nodes are extracted in a one-dimensional manner; the method can restrain the noise of an original hyperspectral image, improve the adaptability of the image convolutional neural network to different hyperspectral images, improve the classification precision, automatically extracts the hyperspectral features, and complete the classification. And the classification accuracy reaches over 93%.

Description

technical field [0001] The invention relates to the technical field of geographic remote sensing, and relates to a hyperspectral image classification method combining a graph structure and a convolutional neural network. Background technique [0002] Hyperspectral images collected from satellites or airborne contain hundreds of contiguous bands, containing rich spectro-spatial information. Due to the unique advantage of hyperspectral, which can distinguish land cover classes at the pixel level, hyperspectral classification that classifies each pixel as a specific label has attracted much attention. Hyperspectral classification has been applied in various fields such as land management, environmental monitoring, military survey, and agricultural assessment. However, hyperspectral high dimensionality, insufficient labeled training samples, and complex spectral noise effects bring great difficulties to hyperspectral classification, and various methods have been studied to solv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V20/13G06V10/26G06V10/40G06V10/762G06V10/771G06V10/764G06V10/774G06V10/80G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/213G06F18/23G06F18/214G06F18/24G06F18/253
Inventor 丁遥张志利蔡伟赵晓枫阳能军尉成果
Owner 中国人民解放军火箭军工程大学
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products