Unlock instant, AI-driven research and patent intelligence for your innovation.

An Image Retrieval Method Based on Ranking Learning and Multivariate Loss

An image retrieval and sorting learning technology, applied in still image data retrieval, digital data information retrieval, still image data clustering/classification, etc. , to achieve the effect of accurate retrieval

Active Publication Date: 2022-05-31
JILIN UNIV
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The model trained by ternary loss has a lot of randomness when selecting samples, which takes a long time, which will lead to relatively large intra-class distance, and has weak generalization ability from training to testing.
Thus quadruple networks, hard sampled triplets, and boundary sample mining networks emerged, however, these Siamese networks usually rely on simpler network architectures than the one we use here, which involves several regions The collection and aggregation of image retrieval has low accuracy and robustness. More importantly, the existing metric learning network performs feature learning by pulling the positive samples closer and pushing away the negative samples. In the distance setting, the same value is used, but not all negative samples have the same dissimilarity with the query image, so this design is difficult to accurately extract the features of the image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Image Retrieval Method Based on Ranking Learning and Multivariate Loss
  • An Image Retrieval Method Based on Ranking Learning and Multivariate Loss
  • An Image Retrieval Method Based on Ranking Learning and Multivariate Loss

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

Image retrieval has an important impact, and an image retrieval method based on ranking and multivariate loss is proposed. As shown in Figure 1,

The image retrieval method includes the following steps:

[0024] Step 1: Extract the underlying features of the query image and the image in the training database.

[0025] The underlying features are extracted to obtain an initial representation of the query image. The present invention adopts Resnet101 fine-tuning network

The image features are preliminarily processed, and generalized mean pooling is used for the pooling operation.

[0026] The pooling layer adopts generalized mean pooling, and for each channel, the generalized average of all activation values ​​on the channel is taken.

The mean is used as the output value of the channel pooling layer.

The computing mode of described generalized mean pooling is:

[0028]

In formula, |x

K

|represents the number of feature vectors, X represents the pixel value of the featu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image retrieval method based on ranking learning and multivariate loss. The core idea of ​​the method is to obtain the sequence number in the similarity ranking of the query image while selecting the negative sample group for the query image, and sort the The sequence number and features are combined to obtain the loss function and update the network, so as to accurately extract image features. The invention introduces the theory of ranking learning into image retrieval, adjusts network parameters according to the Euclidean distance between negative samples and query pictures, and can learn image features more comprehensively to perform more accurate retrieval. The present invention fully considers the impact of negative samples on experiments, and can adjust the number of negative samples according to the training effect of the model.

Description

An Image Retrieval Method Based on Ranking Learning and Multivariate Loss technical field The present invention belongs to the technical field of image retrieval, relate to a kind of image retrieval method based on sorting learning and multivariate loss Law. Background technique [0002] With the large-scale popularization of digital cameras and smart phones in recent years and the continuous increase in the capacity of storage devices, many Media content, especially visual data, has shown an explosive growth trend. For massive visual content, how to quickly Effective retrieval is a research hotspot in academic and industrial circles at home and abroad. [0003] At present, the method of large-scale search engines for Internet image retrieval is mainly based on the pre-trained classification network. The network is initialized and trained for different tasks, which is called a fine-tuning network. Validation-based fine-tuning The network is mainly used in image ret...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/583G06F16/55G06K9/62
CPCG06F16/583G06F16/55G06F18/214G06F18/24137
Inventor 刘萍萍赵宏伟范丽丽王鹏勾贵霞王振王慧
Owner JILIN UNIV