A method and device for image description

Abstract

The present application provides a method and device for image description. The method includes: using multiple first feature extraction models to perform feature extraction on a target image to obtain image features generated by each first feature extraction model; The image features generated by the feature extraction model are fused to generate the global image features corresponding to the target image; the second feature extraction model is used to extract the features of the target image to obtain the target detection features corresponding to the target image; the global image features corresponding to the target image and The target detection features are input to the translation model, and the generated translation sentences are used as the description sentences of the target image, so that in the subsequent process of inputting the global image features and target detection features corresponding to the target image into the translation model to generate translation sentences, there are more The global image features of the image information are used as a reference to make the output translation sentences more accurate.

Description

technical field [0001] The present application relates to the technical field of image processing, and in particular to an image description method and device, a computing device, and a computer-readable storage medium. Background technique [0002] Image description is to automatically generate a descriptive text based on the image, similar to "talking through pictures". For humans, image description is a simple and natural thing, but for machines, this task is full of challenges. The reason is that the machine must not only detect the objects in the image, but also understand the relationship between the objects, and finally express them in a reasonable language. [0003] In the prior art, the process of image description requires a machine to extract local information and global information from the target image, input the global information and local information into the translation model, and use the sentence output by the translation model as the description informati...

AI Technical Summary

Problems solved by technology

In this case, the extraction of global information by the feature extraction model depends on the performance of the feature extraction model itself. Some feature extraction models will pay attention to one type of information in the image, and some feature extraction models will pay attention to another type of information in the image. One type of information, which will cause the translation model to often fail to use the complete global information corresponding to the image as a reference in the subsequent process, resulting in deviations in the output sentences

Images