Image description generation method and device and electronic equipment

An image description and image feature technology, applied in instruments, character and pattern recognition, word processing, etc., can solve problems such as model effect decline

Pending Publication Date: 2020-01-21
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing decoding model is relatively simple, resulting in a significant decline in the effect of the model when the sentence is long or the sentence structure is relatively complex.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image description generation method and device and electronic equipment
  • Image description generation method and device and electronic equipment
  • Image description generation method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art.

[0040] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, means, steps, etc. may be employed. In other instances, well-known methods, ap...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an image description generation method and device and electronic equipment, and relates to the field of artificial intelligence. The method comprises the following steps: acquiring an input image, and encoding objects contained in each image area in the input image to acquire a first image feature; processing pixels in the first image feature according to a preset rule, anddetermining a second image feature according to the processed pixels; and on the basis of the second image feature and the initial word vector, decoding the region feature corresponding to each imageregion in the first image feature at different moments to obtain a word vector corresponding to each image region, and forming text description corresponding to the input image according to the word vector, the initial word vector being an initial mark of the text description. According to the image description generation method, on one hand, natural language information contained in the input image can be extracted more accurately and effectively; on the other hand, the method can be applied when sentences are long or sentence pattern structures are complex, and the accuracy and fluency of text description are improved.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, and in particular, to an image description generation method, an image description generation device, and electronic equipment. Background technique [0002] Image generation description is the analysis and research of generating a natural language description for a picture that can express its meaning, and has broad application prospects. For example, by generating a text description for a picture, it can help the visually impaired to quickly and accurately understand the content of the image; in the field of preschool education, generating an intuitive and accurate description of pictures for children can give children better enlightenment learning and so on. [0003] Inspired by the successful application of neural networks in image recognition and machine translation, many existing methods generate image-text descriptions based on neural network models. At present, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/62
CPCG06V10/40G06F18/29G06F40/30G06V10/82G06F40/10G06F40/40G06V10/50G06V10/95G06F18/214
Inventor 柯磊裴文杰李睿宇沈小勇戴宇荣贾佳亞
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap