Data retrieval method and system based on multi-image weighted fusion

A technology of data retrieval and weighted fusion, applied in the field of information retrieval, can solve problems such as heterogeneity between multimodal data, inconsistent underlying feature structure, and inability to achieve accurate retrieval, so as to improve retrieval performance, improve training and retrieval speed , Improve the effect of mutual retrieval performance

Active Publication Date: 2022-05-06
SHANDONG JIANZHU UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in practical applications, data of different modalities often have inconsistent underlying feature structures, that is, the heterogeneity problem among multimodal data
At the same time, for large-scale databases, traditional multimedia retrieval technologies often cannot achieve accurate retrieval due to limitations in storage space and computing costs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data retrieval method and system based on multi-image weighted fusion
  • Data retrieval method and system based on multi-image weighted fusion
  • Data retrieval method and system based on multi-image weighted fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Such as figure 1 As shown, this embodiment provides a data retrieval method based on multi-image weighted fusion, which specifically includes the following steps:

[0041] S101: Obtain a mapping matrix based on the objective function, and then project the test data according to the mapping matrix to generate a hash code matrix of the test data correspondingly.

[0042] Among them, the objective function consists of six items, the first two items are latent factor matrices of different modal data obtained by using co-matrix decomposition; the third item is to learn the similarity graph matrix within and between modalities; The unified consensus graph matrix and latent factor matrix among the states are used to generate a unified hash code matrix; the fifth item is to learn the hash function; the sixth item is the regularization item.

[0043] In a specific implementation, in the objective function, the goal of collaborative matrix decomposition is to learn the hash code...

Embodiment 2

[0083] Such as figure 2 As shown, this embodiment provides a data retrieval system based on multi-image weighted fusion, which specifically includes the following modules:

[0084] (1) Hash code matrix generation module, which is used to obtain the mapping matrix based on the objective function, and then project the test data according to the mapping matrix, and generate the hash code matrix of the test data correspondingly;

[0085]Among them, the objective function consists of six items, the first two items are latent factor matrices of different modal data obtained by using co-matrix decomposition; the third item is to learn the similarity graph matrix within and between modalities; The unified consensus graph matrix and latent factor matrix among the states are used to generate a unified hash code matrix; the fifth item is to learn the hash function; the sixth item is the regularization item.

[0086] The expression of the objective function is:

[0087]

[0088] In ...

Embodiment 3

[0095] This embodiment provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps in the above-mentioned data retrieval method based on multi-image weighted fusion are implemented.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of information retrieval and provides a data retrieval method and system based on multi-image weighted fusion. In order to solve the problem of inaccurate retrieval, the retrieval method includes obtaining the mapping matrix based on the objective function, and then projecting the test data according to the mapping matrix to generate the hash code matrix of the test data; calculating the hash code matrix of the test data and obtaining the hash code matrix based on the objective function. The Hamming distance between the hash code matrices of the training data is sorted to obtain the retrieval results of the test data; among them, the objective function is composed of six items, and the first two items are obtained by using the collaborative matrix decomposition to obtain different modal data Latent factor matrix; the third item is to learn the similarity graph matrix within and between modalities; the fourth item is to generate a unified hash code matrix through the unified consensus graph matrix and latent factor matrix between modalities; the fifth item is to learn the hash function; the sixth term is the regularization term. It has the characteristics of fast training and retrieval speed and high retrieval performance.

Description

technical field [0001] The invention belongs to the technical field of information retrieval, and in particular relates to a data retrieval method and system based on multi-image weighted fusion. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] With the rapid development of network technology and the exponential growth of different modal data in social media, it is no longer limited to similarity retrieval between single-modal data, but more mutual retrieval between multi-modal data. The task of multimodal retrieval is to find a set of semantically similar objects in another modality given a query object in one modality, such as text retrieval image, image retrieval text, etc. However, in practical applications, data of different modalities often have inconsistent underlying feature structures, that is, the heterogeneity problem among mult...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/33G06F16/583
Inventor 刘兴波李佳敏聂秀山王少华尹义龙
Owner SHANDONG JIANZHU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products