Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

High-level feature fusion classification method for multi-modal remote sensing images based on deep learning

A high-level feature and remote sensing image technology, applied in the field of machine learning, can solve the problems of limited selection of multiple modes and difficulty of remote sensing images, and achieve the effect of improving utilization rate and high precision

Active Publication Date: 2021-12-07
SHANGHAI OCEAN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When dealing with multimodal remote sensing images from multiple sensors, different resolutions, and different physical representations, although machine learning has been widely used in remote sensing image classification, there are still four problems in this type of method: (1) The choice of multiple modalities is limited; (2) The spectrum, dimension, time phase, resolution and other characteristics of remote sensing images make data processing a severe challenge; (3) How to establish the interaction between multiple modalities It is difficult to improve the classification accuracy of remote sensing images; (4) With the development of remote sensing technology, massive remote sensing image processing is facing challenges
[0010] However, there is no method that can effectively overcome the four problems in the application of machine learning to remote sensing image classification as mentioned above, and can quickly, efficiently and safely classify complex and massive remote sensing data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-level feature fusion classification method for multi-modal remote sensing images based on deep learning
  • High-level feature fusion classification method for multi-modal remote sensing images based on deep learning
  • High-level feature fusion classification method for multi-modal remote sensing images based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] See figure 1 , figure 1 It is the construction and application process of the deep learning-based multi-modal remote sensing image high-level feature fusion classification method of the present invention. The described deep learning-based multimodal remote sensing image high-level feature fusion classification method has the following components:

[0064] Step 1, preprocessing of multimodal remote sensing data sets, making training sets, verification sets, and test sets of high-level feature extractors for the construction of high-level feature extractor model parameters;

[0065] Step 2, the model construction of the multimodal high-level feature extractor is used to extract the high-level features of multiple modal remote sensing images;

[0066] Step 3, the extraction and storage of high-level features of multi-modal remote sensing images, used for training, verification and testing of multi-classifiers;

[0067] Step 4, the high-level feature fusion algorithm is ...

Embodiment 2

[0110] In this embodiment, the remote sensing satellite image classification database UC Merced Land UseDataset containing 21 types of scenes and the NWPU-RESISC45 dataset created by Northwestern Polytechnical University for remote sensing image scene classification are selected. The resolutions of the two datasets are different and considered as two modalities. In the present invention, the data set is made as follows in the binary classification experiment: for UC Merced Land Use Dataset, since the number of remote sensing images of each class is only more than 100 pieces, in order to expand the data set, the data is processed on the basis of the existing data set. A dataset of 1000 256*256 remote sensing images is obtained by randomly twisting, segmenting, and changing image brightness; for the NWPU-RESISC45 dataset, each category has 700 remote sensing images, and the same method is used to expand the dataset to 1000.

[0111] According to the ratio of 7:1:2, two sets of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method for fusion and classification of high-level features of multi-modal remote sensing images based on deep learning, which comprises the following steps: preprocessing multi-modal remote sensing data sets, making training sets, verification sets, and test sets for high-level feature extractors, It is used for the construction of high-level feature extractor model parameters; the model construction of multi-modal high-level feature extractor is used to extract high-level features of multiple modal remote sensing images; the extraction and storage of high-level features of multi-modal remote sensing images is used for multi-modal Classifier training, verification and testing; high-level feature fusion algorithm, used to make training set, verification set and test set of classifier; construction of classifier model parameters, used for classification of newly generated data sets. The present invention can achieve remarkable results in the classification of remote sensing images and ground features through deep learning, and is suitable for complex and massive remote sensing image classifications. use value.

Description

technical field [0001] The invention relates to the field of machine learning, in particular to the field of deep learning, and in particular to a method for fusion and classification of high-level features of multi-modal remote sensing images based on deep learning. Background technique [0002] With the development of remote sensing technology, it is of great research value to efficiently apply remote sensing technology to regional land surveys, quantitatively extract land use information, and monitor and evaluate the environment. Among them, remote sensing image classification technology, as an important support for remote sensing applications, has been widely used in thematic information extraction, change detection, thematic map production and the establishment of remote sensing databases. [0003] Remote sensing image classification is a key technology in remote sensing application systems. Its main task is to interpret and identify the attributes and distribution of g...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V20/13G06F18/24133G06F18/24147
Inventor 贺琪黄冬梅李瑶杜艳玲查铖李明慧
Owner SHANGHAI OCEAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products