Image semantic description method and system based on multi-feature extraction

A technology of semantic description and feature map, which is applied to instruments, biological neural network models, character and pattern recognition, etc. It can solve the problems of low accuracy of semantic description and single image feature LSTM can only capture one-way time series information.

Active Publication Date: 2020-08-18
CHINA UNIV OF MINING & TECH
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above analysis, the embodiment of the present invention aims to provide a method and system for image semantic description based on multi-feature extraction to solve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic description method and system based on multi-feature extraction
  • Image semantic description method and system based on multi-feature extraction
  • Image semantic description method and system based on multi-feature extraction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] Preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of the application and together with the embodiments of the present invention are used to explain the principle of the present invention and are not intended to limit the scope of the present invention.

[0074] Compared with the prior art, this application provides an image semantic description method based on multi-feature extraction, such as figure 1 shown. For the input image, the global feature vector V of the image is obtained through the global feature extraction model img , the attribute feature vector V of the image is obtained through the attribute feature extraction model att , then V img and V att At the same time, the bidirectional long-short-term memory network is input to obtain a joint loss function. When the joint loss function is minimized, a semantic description matching ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image semantic description method and system based on multi-feature extraction, belongs to the technical field of image feature extraction, and solves the problems that inthe prior art, extracted image features are single, and a long-short-term memory network can only capture one-way time sequence information. The method comprises the following steps: inputting an image to be semantically described into a global feature extraction model to obtain a global feature vector of the image; extracting an attribute feature vector of the image; simultaneously inputting theglobal feature vector and the attribute feature vector into a bidirectional long-short term memory network to obtain a forward joint loss function and a backward joint loss function; and accumulatingand summing the forward joint loss function and the backward joint loss function, and when the sum is minimum, obtaining semantic description which is optimally matched with the image. The extractionof multiple image features is realized, and the accuracy of semantic description is improved.

Description

technical field [0001] The invention relates to the technical field of image feature extraction, in particular to an image semantic description method and system based on multi-feature extraction. Background technique [0002] Image semantic description has always been one of the most important research directions in the field of artificial intelligence, and it is an advanced task for image understanding. At present, image semantic description methods based on deep neural networks have made major breakthroughs in this field, especially the semantic description generation model that combines convolutional neural networks and recurrent neural networks. [0003] Mao et al. creatively combined convolutional neural network and recurrent neural network to solve problems such as image description and sentence retrieval. After that, Kiros et al. took the lead in introducing the encoding-decoding framework into the research of image semantic description. They utilize deep convoluti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/46G06N3/04
CPCG06V10/40G06N3/045G06N3/044Y02D10/00
Inventor 赵小虎有鹏李晓常先红宋瑞军张楠
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap