An image description method based on deep learning

Abstract

The invention discloses an image description method based on deep learning. The method comprises the steps of dividing an image data set into a training set and a test set; constructing an image description model; training a residual network pre-training model on the ImageNet data set, and loading residual network pre-training model parameters into a deformable convolutional residual network in the image description model; sending the images in the training set into a spatial transformation network, sending an output result of the spatial transformation network to a deformable convolutional residual network, and outputting feature vectors of the images by the deformable convolutional residual network; generating a text sequence corresponding to the image; completing the construction of thelanguage model to generate statements corresponding to the image; using an AdamW optimization algorithm to train the image description model; outputting a description statement corresponding to the image; the extracted image features have better spatial expression capability, the generated sentences are high in accuracy, the language structure is rich, the model training time is short, and the convergence speed is high.

Description

technical field [0001] The invention belongs to the field of artificial intelligence deep learning, in particular to an image description method based on deep learning. Background technique [0002] Image description is the automatic translation of an image by a machine into a sentence that humans can understand. It is a fundamental problem involving computer vision, natural language processing, and machine learning. The system not only needs to identify the objects in the image, but also identifies the attributes, positions and relationships between the objects in the image, and then converts them into sentences with a certain grammatical structure through natural language processing. Image captioning has great implications in helping people with visual impairments alleviate visual impairments, early infancy education, and image retrieval. [0003] The traditional image description is based on templates and semantic transfer-based methods, but the sentence structure genera...

AI Technical Summary

Problems solved by technology

[0004]The network models used in these methods have problems such as slow model convergence, low accuracy of generated sentences, and simple structure

Images