A Text Hash Retrieval Method Based on Deep Learning

A deep learning and text technology, applied in the field of text hash retrieval, can solve the problems of inability to effectively guarantee text semantic similarity, low coding retrieval efficiency, increased semantic retrieval cost, etc., to improve query accuracy, improve expression ability, The effect of enhancing learning ability

Active Publication Date: 2022-04-01
广西白鲸信息技术有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] As the scale and dimension of data increase, the cost of semantic retrieval increases sharply. As an important way to achieve efficient semantic retrieval, text hashing has received extensive attention; however, most text hashing algorithms directly use machine learning The mechanism maps the explicit features or keyword features in this paper to binary codes, which cannot effectively guarantee the semantic similarity between texts, resulting in low retrieval efficiency of codes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention is described in further detail below.

[0028] A depth learning text hash retrieval method, including the following steps:

[0029] 1 Gets to be retrieved by S original vocabulary data, and preprocessing the original vocabulary data for cleaning and particle pretreatment of the original vocabulary data, obtains the pretreatment text library data.

[0030] 2 Define the hash model to be trained as follows:

[0031] 2-1 Treat word embedding of the pre-treated text library data to obtain the word embedding matrix;

[0032] 2-2 Construct a two-way LSTM model, embed the word embedded matrix input two-way LSTM model, resulting in semantic code corresponding to each original vocabulary data;

[0033] 2-3 Use the text convolutional neural network to extract each semantic code-encoded N-Gram feature;

[0034] 2-4 Extract the attention characteristics of each semantic code using the attention mechanism;

[0035] 2-5 combines each semantic N-GRAM feature and atten...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a text hash retrieval method based on deep learning, which is characterized by first using a bidirectional LSTM model to extract the semantic code corresponding to each original vocabulary data in the word embedding matrix, and then connecting the text volume in parallel after the bidirectional LSTM model Integrate the neural network and add the attention mechanism, and then use the sign function to convert the output value of the second fully connected layer into the corresponding hash code, use the hash code to reconstruct the category label, and finally, find the hash code in the text library The vector data closest to the Hamming distance coded by the retrieval text hash code completes the hash retrieval process of the retrieval text data. The advantage is that the hash model has a high learning ability for short texts, and the added attention mechanism can further improve the features. The classification layer uses hash coding to reconstruct category labels, so that the hash model can use label information more finely while learning binary coding, so the retrieval accuracy is higher.

Description

Technical field [0001] The present invention relates to a text hash retrieval method, in particular a depth learning text hash retrieval method. Background technique [0002] As the data size and dimension increases, the price of semantic retrieval increases, text hash as an important way to achieve efficient semantic retrieval; however, most text hash algorithms are directly using machine learning. The mechanism will map the explicit feature or keyword feature of this article. Inventive content [0003] The technical problem to be solved in the present invention is to provide a method of retrieving precision-based text hashing retrieval methods. [0004] The present invention solves the technical solution used in the above technical issues is: a method based on deep learning text hash retrieval method, including the following steps: [0005] 1 Gets to be retrieved by S original vocabulary data, and preprocessing the original vocabulary data for cleaning and particle pretreatmen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/31G06F16/33G06F16/35G06N3/04G06N3/08
CPCG06F16/325G06F16/3331G06F16/35G06N3/08G06N3/044G06N3/045
Inventor 寿震宇钱江波辛宇谢锡炯陈海明
Owner 广西白鲸信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products