Remote sensing image semantic generation method based on fast region convolutional neural network

A convolutional neural network and remote sensing image technology, applied in the field of image semantic generation, can solve the problems that affect the accuracy of image detection, cannot get the relationship between objects in the image, and stop

Active Publication Date: 2018-12-07
XIDIAN UNIV
View PDF5 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method can obtain superficial semantic information for auxiliary recognition, but the method is not systematic enough, and stays at the stage of target positioning and recognition, and cannot obtain the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote sensing image semantic generation method based on fast region convolutional neural network
  • Remote sensing image semantic generation method based on fast region convolutional neural network
  • Remote sensing image semantic generation method based on fast region convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Below in conjunction with accompanying drawing and specific embodiment, the present invention is described in further detail:

[0024] Refer to attached figure 1 , the realization steps of the present invention are as follows.

[0025] Step 1: Construct training sample set and test sample set.

[0026] Download the UCM-Captions Data Set, Sydney-Captions Data Set and RSICD three remote sensing image semantic generation datasets from the website of the State Key Laboratory of Surveying, Mapping and Remote Sensing at Wuhan University, and use 60% of the image-text pairs in each dataset as training samples. The remaining 40% image-text pairs are used as test samples.

[0027] Step 2 uses the fast area convolutional network to extract the image features of the remote sensing images in the training samples:

[0028] The structure of the fast area convolutional network is as follows figure 2 As shown, it contains a region candidate network and a three-layer convolutional ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a remote sensing image semantic generation method based on a fast region convolutional neural network. The problems are overcome that relation between images in an imagecannot be obtained and a relation between a target and the whole image cannot be obtained. The method comprises the steps of: constructing a training sample set and a test sample set; employing a fast region convolutional neural network to extract image features of a high-resolution remote sensing image; employing a bidirectional recurrent neural network to extract text features of correspondingsentences; employing an image-text matching model based on probability to match the image features with the text features; and employing the matching image-text features to perform training for a long-and-short time memory network for training so as to achieve semantic generation of the high-resolution remote sensing image. The remote sensing image semantic generation method fully considers the features of complex remote sensing image backgrounds and multiple targets so as to improve the result of remote sensing image semantic generation, and can be used for image retrieval or scene classification.

Description

technical field [0001] The invention belongs to the technical field of image processing, in particular to an image semantic generation method, which can be used to automatically describe the contents of remote sensing images. Background technique [0002] The understanding and description of remote sensing image content can provide decision-level support for remote sensing applications, and has a wide range of practical application values. For example, in the field of military reconnaissance, existing research algorithms can quickly identify important military targets such as ports, airports, and ships from remote sensing images. The understanding and description of remote sensing image content can accurately and comprehensively understand large and wide battlefield images, so as to realize real-time interpretation of battlefield geographical environment and dynamic intelligence generation. In terms of civilian use, the understanding and description of remote sensing image ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/04G06N3/08G06V10/757
Inventor 张向荣李翔朱鹏焦李成唐旭侯彪马晶晶马文萍
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products