Freehand sketch recognition method based on attention mechanism

Abstract

The invention discloses a freehand sketch recognition method based on an attention mechanism, and the method comprises the steps: inputting an original freehand sketch into a deep convolution neural network, and obtaining a feature map outputted by a last convolution layer; inputting the feature map into a channel attention module to obtain a feature map based on channel attention optimization; training a classification network used for predicting the vertical overturn of the freehand sketch, and inputting the original freehand sketch into the trained classification network to obtain a vertical overturn space attention graph; combining the feature map based on the channel attention optimization and the vertical overturning space attention map, and calculating to obtain a feature map basedon the vertical overturning space attention optimization; and finally, outputting an identification result through the full connection layer. The method has the advantages that channel attention and vertical overturn space attention are adopted to optimize the characteristics of the convolutional neural network, so that the network can pay attention to learning of a part with higher discrimination, and therefore, the recognition precision of the freehand sketch can be effectively improved.

Description

technical field [0001] The invention belongs to the field of computer vision, relates to hand-drawn sketch classification tasks, and in particular to a hand-drawn sketch recognition method based on an attention mechanism. Background technique [0002] Hand-drawn sketches can be regarded as an abstract form on a two-dimensional plane, which not only shows the information to be expressed, but also contains infinite space for imagination. It can be conveniently used to describe objects or scenes, outline storylines, design products or buildings, etc. It is widely used in painting and design work, such as comic production, urban planning and design, architectural composition, industrial design and fashion design, etc. . The related technologies of hand-drawn sketch recognition can be applied in many fields of computer vision, such as image retrieval and generation, 3D graphics retrieval and reconstruction, etc., so it has received more and more attention in recent years. [00...

AI Technical Summary

Problems solved by technology

However, due to the high abstraction of hand-drawn sketches, it is difficult to effectively model hand-drawn sketc

Images