Cross-modal hash retrieval method based on triple deep networks

A deep network and triplet technology, applied in the field of computer vision, can solve the problem of low retrieval accuracy, and achieve the effect of improving accuracy, enriching semantic information, and increasing discriminativeness.
CN108170755AActive Publication Date: 2018-06-15XIDIAN UNIV
4 Cites 32 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Current Assignee / Owner
XIDIAN UNIV
Publication Date
2018-06-15

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a cross-modal hash retrieval method based on triple deep networks. The method is used to solve the technical problem of low retrieval precision existing in existing cross-modalhash retrieval methods, and includes the realization steps of: preprocessing data, and dividing the data into training data and query data; acquiring hash codes of image training data and text training data; using triple supervisory information to establish an objective loss function; carrying out orderly iterative optimization on the objective loss function; calculating hash codes of image querydata and text query data; and acquiring retrieval results of the query data. According to the solution provided by the invention, the triple information is used to construct the objective loss function, semantic information is increased, an intra-modal loss function is added at the same time, discriminability of the method is improved, and precision of cross-modal retrieval can be effectively improved. The method can be used for Internet-of-things information retrieval and image and text mutual-searching services of e-commerce, mobile equipment and the like.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of computer vision, and relates to mutual retrieval between large-scale image data and text data, specifically a cross-modal hash retrieval method based on a triple deep network, which can be used for Internet of Things information retrieval, electronic Image and text mutual search service for business and mobile devices. Background technique

[0002] With the rapid development of Internet technology and social networking sites, massive amounts of multimedia data, such as text, images, video, and audio, are generated every day. The mutual retrieval of cross-modal data has become a research hotspot in the field of information retrieval. Hash method is a very effective information retrieval method, which has the advantages of low memory consumption and fast retrieval. Hash methods can be divided into single-modal hash methods, multi-modal hash methods and cross-modal hash methods. The query data and retrieva...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More