Image description information generation method and device, computer equipment and storage medium

A technology for image description and information generation, applied in the field of image processing, can solve problems such as poor accuracy and poor accuracy of image description information, and achieve the effect of improving accuracy

Pending Publication Date: 2021-10-29
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the above-mentioned related technologies, only relying on the visual features of the image will lead to poor accuracy of the non-visual vocabulary of the generated image description information, such as verbs, prepositions, etc., resulting in poor accuracy of the generated image description information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image description information generation method and device, computer equipment and storage medium
  • Image description information generation method and device, computer equipment and storage medium
  • Image description information generation method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0063] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0064] It should be understood that the "plurality" mentioned herein refers to two or more than two. "And / or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and / or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character " / " generally indicates that the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image description information generation method and device, computer equipment and a storage medium, and relates to the technical field of image processing. The method comprises the following steps: acquiring a target image; extracting a semantic feature set and a visual feature set of the target image; generating an attention fusion network in the model through the image description information, carrying out attention fusion on the semantic features of the target image and the visual features of the target image on n time steps, and obtaining descriptors corresponding to the n time steps; and generating image description information of the target image based on the descriptors corresponding to the n time steps. By means of the method, in the process of generating the image description information, the advantage of the visual features in the aspect of generating the visual vocabularies and the advantage of the semantic features in the aspect of generating the non-visual features are complementary, and therefore the accuracy of generating the image description information is improved.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a method, device, computer equipment and storage medium for generating image description information. Background technique [0002] With the development of image recognition technology, the computer's function of "looking at pictures and talking" can be realized through algorithms, that is, image description, which converts the content information in the image into image description information. [0003] In related technologies, the image description information of the image is often generated by extracting the visual features of the image, that is, after the visual features of the image are obtained by an encoder, a recurrent neural network is used to generate an overall description of the image. [0004] However, in the above-mentioned related technologies, only relying on the visual features of the image will lead to poor accuracy of the non-visual vocabular...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06F40/30G06N3/08G06N3/04
CPCG06F40/30G06N3/08G06N3/045G06F18/253G06V10/82G06V10/40G06V10/464G06V10/7715G06V20/46G06V20/41G06V10/44G06V10/26G06V10/764
Inventor 高俊
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap