Data processing method for sketch retrieval

A sketch and data processing technology, which is applied in the fields of electronic digital data processing, special data processing applications, and still image data retrieval, etc., can solve problems such as the decline of source domain classification ability, the reduction of sketch retrieval accuracy, and the deterioration of reasoning ability, so as to improve Generalization performance and anti-interference ability, enhanced ability to extract image features, and enhanced reasoning ability

Inactive Publication Date: 2020-11-13
JINLING INST OF TECH
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, after knowledge transfer, although the classification ability of the obtained Siamese network on the target domain is continuously improved, the classification ability on the source domain is greatly reduced, resulting in the deterioration of the overall reasoning ability and the reduction of the accuracy of sketch retrieval.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method for sketch retrieval
  • Data processing method for sketch retrieval
  • Data processing method for sketch retrieval

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0048] figure 2is an exemplary flow chart of the method for training an image encoder and a sketch encoder in the present invention, such as figure 2 As shown, the method may include steps 101 to 106.

[0049] 101. Acquire an image classifier from a source domain and its corresponding category set.

[0050] Exemplarily, some common image libraries can be used as source domains, for example, ImageNet data sets, Sketchy data sets, TU-Berlin sketch data sets, etc. can be used. These image libraries can provide rich labeled images, which can be used for Train various models.

[0051] Among them, the ImageNet dataset refers to the public dataset used in the ImageNet largescale visual recognition challenge (ILSVRC) competition;

[0052] The Sketchy dataset refers to a large-scale sketch-image pair dataset, containing 75,479 sketches a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method for sketch retrieval. A knowledge preserving mechanism is introduced; on the basis of a domain loss function, a triple loss function and a semantic lossfunction, a knowledge preserving loss function is additionally constructed, and all the loss functions are used for training; in the knowledge migration process of the pre-training model, new knowledge of a target domain can be learned, knowledge learned from a source domain can be kept, and sketch retrieval precision is improved.

Description

technical field [0001] The invention relates to the field of sketch retrieval. In particular, it relates to a data processing method for sketch retrieval. Background technique [0002] At present, there are two main retrieval methods, one is text-based image retrieval, users search for images with the same or similar tags through keyword search; the other is content-based image retrieval, users search for the same or similar content by inputting images Additional pictures of . Among these retrieval methods, with the use of touch-screen devices becoming more and more common, hand-drawn sketches are convenient and fast, so the technology of using sketches to retrieve images shows great potential. Sketch retrieval aims to retrieve pictures similar to it using simple line outlines. Using deep learning technology to build a retrieval model requires a large number of data samples. However, the image information in the world is very rich, but the sketch materials are relatively ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/532G06F16/55G06F16/58G06K9/62
CPCG06F16/532G06F16/5866G06F16/55G06F18/24G06F18/214
Inventor 沈乾彦赵海峰
Owner JINLING INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products