Fine-grained freehand sketch image retrieval method based on attention enhancement

An attention and fine-grained technology, applied in the field of cross-media retrieval, it can solve the problems of low image accuracy and inconsistent target objects, and achieve the effect of excellent performance.
CN111488474AActive Publication Date: 2020-08-04FUDAN UNIV
3 Cites 20 Cited by

Patent Information

Authority / Receiving Office
CN ยท China
Current Assignee / Owner
FUDAN UNIV
Publication Date
2020-08-04

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention belongs to the technical field of cross-media retrieval, and particularly relates to a fine-grained freehand sketch image retrieval method based on attention enhancement. According to the deep fine-grained freehand sketch image retrieval FG-SBIR model, different attention mechanisms are used to further pay attention to fine-grained details between a sketch and an image. The new modelnot only pays attention to correlation information between a sketch mode and an image mode, but also pays attention to distinctiveness information in a single mode. According to the invention, a mutual loss method is provided to enhance the traditional triple loss and improve the discrimination capability of the model on the fine-grained characteristics in a single mode. For a given query sketch,related images with fine-grained instance-level similarity in a specific category can be returned, and the strict requirement for instance-level retrieval of fine-grained freehand sketch image retrieval is met.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of cross-media retrieval, and in particular relates to a fine-grained hand-drawn sketch image retrieval method based on enhanced attention. Background technique

[0002] With the ubiquity of mobile devices these days, it's becoming ever more convenient for people to sketch on-screen. Especially when searching for a specific image, people need to give a long textual description, but in fact they can also draw a sketch containing fine-grained visual features to express the retrieval needs. Therefore, Fine-grained Sketch-based Image Retrieval (FG-SBIR) has aroused extensive research interest of scholars. In recent years, although fruitful research results have been obtained in this field, it still faces many challenging problems, and more in-depth research work is needed to obtain better solutions. These challenging issues include, how to reduce the semantic difference between sketches and images from differe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More