An image description method constructed based on a hierarchical feature relation graph

A technology of image description and relationship diagram, applied in the field of computer vision recognition, can solve the problem of not considering the relationship information of objects

Active Publication Date: 2019-05-03
SUN YAT SEN UNIV
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods still have shortcomings. Most of the image description methods in the prior art only use the information of a singl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An image description method constructed based on a hierarchical feature relation graph
  • An image description method constructed based on a hierarchical feature relation graph
  • An image description method constructed based on a hierarchical feature relation graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] The accompanying drawings are for illustrative purposes only and cannot be construed as limiting the patent;

[0075] In order to better illustrate this embodiment, some parts in the drawings will be omitted, enlarged or reduced, and do not represent the size of the actual product;

[0076] For those skilled in the art, it is understandable that some well-known structures and descriptions thereof may be omitted in the drawings.

[0077] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0078] Such as figure 1 As shown, it is a flow chart of the image description method constructed based on the hierarchical feature relationship graph in this embodiment.

[0079] The image description method constructed based on the hierarchical feature relationship graph of this embodiment includes the following steps:

[0080] Step 1: Collect training images, coordinate information of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of computer vision recognition, and provides an image description method constructed based on a hierarchical feature relation graph, which comprises the following steps: constructing a training data set; inputting the image into a block detection module, and outputting block visual information; inputting the image into a target detection module, and outputting target visual information; inputting the image into a text detection module, and outputting text visual information; Respectively inputting the three visual information into a description generator, respectively constructing a relational graph of each type of visual information and training image coordinate information, and optimizing the three visual information; Screening and fusing the three types of visual information to obtain multi-modal characteristics; inputting the description words into a recurrent neural network to extract feature information, and predicting the next description wordto generate a complete description sentence. According to the method, various types of visual information are optimized, screened and fused, so that any input test image is described, and the image description accuracy can be effectively improved.

Description

technical field [0001] The present invention relates to the field of computer vision recognition, and more specifically, relates to an image description method constructed based on a hierarchical feature relationship graph. Background technique [0002] In recent years, image description, as an interdisciplinary subject between computer vision and natural language processing, has received more and more attention. Image description means that given an input image, an algorithm needs to be designed so that the computer learns to describe the content in the image with grammatically and semantically correct sentences. Therefore, image description is very difficult for machines, because machines need to learn to recognize information such as objects and scenes in images, and at the same time need to understand the internal relationship between different objects, objects and backgrounds. But this research direction is valuable, because image description has a wide range of applic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62
CPCY02T10/40
Inventor 胡海峰王伟轩于遨波陈志鸿朱蔚中
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap