Cross-media retrieval method based on local sensitive hash algorithm and neural network

A locality-sensitive hash and neural network technology, applied in the field of cross-media retrieval, can solve the problem of cross-media retrieval methods ignoring the optimization of document sets, and achieve the effect of efficient retrieval tasks

Active Publication Date: 2017-05-10
NAT UNIV OF DEFENSE TECH
View PDF5 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0014] The existing cross-media retrieval methods all have the same technical defect, that is, only considering the cross-media retrieval method itself and ignoring some feasible optimization processing of the document set, because there are a large number of irrelevant documents in the document set, so Preprocessing the document set before precise query, increasing the proportion of relevant documents in the document set is of great significance for improving retrieval efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-media retrieval method based on local sensitive hash algorithm and neural network
  • Cross-media retrieval method based on local sensitive hash algorithm and neural network
  • Cross-media retrieval method based on local sensitive hash algorithm and neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will now be described in detail with reference to the drawings.

[0052] A specific embodiment of the present invention provides a cross-media retrieval method (Fast Cross-Media Retrieval, FCMR) based on a local sensitive hash algorithm and a neural network. The cross-media retrieval method mainly includes the following steps:

[0053] 1) Establish an FCMR (Fast Cross-Media Retrieval, FCMR) model, and the training process of the FCMR model includes a locally sensitive hash stage and a hash function learning stage;

[0054] 2) Use the local sensitive hash function and the hash function learned by the neural network to map all text and images to the Hamming space to establish an index;

[0055] 3) Perform cross-media search queries, including text queries and image queries.

[0056] Among them, in order to make the symbol and algorithm expression more concise, the following describes the proposed FCMR model with two modalities of text and image as examples. Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cross-media retrieval method based on local sensitive hash algorithm and neural network, and relates to the technical field of cross-media retrieval. The method comprises two stages of local sensitive hash and hash function learning, wherein in the stage of local sensitive hash, the image data is mapped to hash buckets in m hash tables G = [g1, g2,...,gm] (which is an element of a set R<k*m>) by the local sensitive hash algorithm, wherein G is the set of m hash tables, gj is the jth hash table, and k is the length of the hash code corresponding to the hash bucket; and in the stage of hash function learning, the text data is respectively mapped to hash functions Ht = (Ht (1), Ht (2), ..., Ht (m), Ht (j)) in corresponding hash buckets in m hash tables by the neural network algorithm learning, wherein Ht (j), (1<=j<=m) represents the learned hash function Ht corresponding to the jth hash table. After getting the functions of these two phases, all the images and the documents are further coded and indexed for more accurate retrieval.

Description

Technical field [0001] The invention relates to the technical field of cross-media retrieval, in particular to a cross-media retrieval method based on a local sensitive hash algorithm and a neural network. Background technique [0002] In the era of cross-media big data, the massive multi-modal information generated all the time has brought huge cross-media retrieval needs, such as using text to search for images or videos, and vice versa. For example, an entry on Wikipedia usually contains text descriptions and example images. The retrieval of this information requires the construction of cross-media indexes and learning methods. Compared with traditional single media retrieval, the core problem of cross-media retrieval is how to mine the associations between the same or related semantic objects represented by different media. [0003] At present, many solutions have been proposed for the core problem of cross-media retrieval in the world. Existing cross-media retrieval methods ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06N3/04G06N3/08
CPCG06F16/43G06N3/084G06N3/045
Inventor 白亮贾玉华郭金林谢毓湘于天元
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products