Cross-modal data retrieval system based on text semantic mapping and retrieval method thereof

A technology of data retrieval and semantic mapping, applied in the fields of digital data information retrieval, electronic digital data processing, special data processing applications, etc., can solve the problems that cannot be calculated in advance, the method of correlation measurement cannot be calculated in advance, and the application is limited. , to achieve the effect of improving retrieval accuracy, reducing the number of semantic mappings, and avoiding uncontrollable processes

Active Publication Date: 2020-04-10
INFORMATION SCI RES INST OF CETC +1
View PDF2 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The method based on correlation measurement cannot be calculated in advance, and different modal data pairs (such as image and sentence pairs) must be given at the same time, and it cannot be calculated in advance before the query sample arrives, which limits the application of this type of method under large-scale conditions. application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-modal data retrieval system based on text semantic mapping and retrieval method thereof
  • Cross-modal data retrieval system based on text semantic mapping and retrieval method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

[0046] The present invention lies in: through the method of mapping the semantic information contained in the non-text modal data to the text semantic space, the analysis and calculation of the semantics of the broad modal data are realized, and the multiple mapping and loss caused by the construction of a unified semantic space are avoided. The problem of semantic information; using text labels to represent and label non-text data and training non-text data semantic extraction models will help improve the operabil...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cross-modal data retrieval system based on text semantic mapping and a retrieval method thereof. The retrieval system comprises a data domain, an offline domain, a semantic domain and an online domain, wherein the data domain comprises a text data set and a non-text data set; the offline domain comprises a label extraction module, a text semantic extraction module, a datalabeling module and a non-text semantic model training module; the semantic domain comprises text semantic space; and the online domain comprises a text semantic extraction module, a non-text semantic extraction module, a query expression module, a relevancy calculation module and a relevancy sorting module. According to the method, the non-text data semantics are mapped to the text semantic space, so that the efficiency and operability of system data labeling, model training and retrieval accuracy evaluation are improved, the non-text data semantic mapping frequency is reduced, the originalsemantics of the data are greatly reserved, and the data retrieval accuracy can be effectively improved.

Description

technical field [0001] The invention relates to the field of cross-modal data semantic retrieval, in particular to a cross-modal data retrieval system and retrieval method based on text semantic mapping. Background technique [0002] Cross-modal data is the integration of multi-modal data such as text, image, audio, and video, and describes rich semantic information through different representations. With the rapid development of network technology and the popularization of mobile smart devices, the sources of information are diversified, and the forms of information carrying are diversified. Information retrieval methods have developed from the most simple keyword search to image retrieval, audio and video and other cross-modal data search. [0003] Generally speaking, media data that focuses on a specific mode can only obtain some characteristics of cognitive objects, which is likely to bring certain limitations to data analysis. Now people's demand for Internet informati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/432
CPCG06F16/432
Inventor 张淯舒张德钱茛南方赴洋张志华曹扬
Owner INFORMATION SCI RES INST OF CETC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap