Semantic similarity calculation method based on deep learning

A semantic similarity and deep learning technology, applied in the field of semantic similarity calculation, can solve problems such as imperfect model feature extraction, low accuracy of similarity calculation, shallow network layers, etc., to overcome the problem of gradient disappearance and feature semantic information The effect of enriching and enhancing feature extraction capabilities
CN110348014AActive Publication Date: 2019-10-18UNIV OF ELECTRONICS SCI & TECH OF CHINA
17 Cites 21 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Applications(China)
Current Assignee / Owner
UNIV OF ELECTRONICS SCI & TECH OF CHINA
Publication Date
2019-10-18

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a semantic similarity calculation method based on deep learning, and relates to the field of semantic similarity calculation. The method comprises the following steps: step 1,constructing a training data set, and preprocessing training data to obtain one-hot sparse vectors; step 2, constructing a semantic similarity calculation network model comprising N layers of BI-LSTMnetworks, a residual network, a similarity matrix, a CNN convolutional neural network, a pooling layer and a full connection layer; step 3, inputting the one-hot sparse vector into the network model,and training parameters by using a training data set to complete supervised training; and step 4, inputting a text to be tested into the trained network model, judging whether the text to be tested isa similar text or not, and outputting a result. The semantic similarity calculation network model comprises a multi-layer BI-LSTM network, a residual network, a CNN convolutional neural network, a pooling layer and a full connection layer. Meanwhile, a BI-LSTM network and a CNN convolutional neural network are used, and a residual network is added into the BI-LSTM network, so that the problem ofgradient disappearance caused by a multi-layer network is solved, and the feature extraction capability of the model is enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the field of semantic similarity calculation, in particular to a deep learning-based semantic similarity calculation method. Background technique

[0002] Semantic similarity calculation is a basic task in the field of natural language processing. With the advent of the era of artificial intelligence, more and more scientists and scholars are focusing on the field of natural language processing. The task of semantic similarity calculation is because of its Document copy checking, information retrieval, and machine translation are widely used in fields such as machine translation, and more and more researchers are devoting themselves to the study of semantic similarity calculation. In recent years, due to the rise of deep learning technology, semantic similarity calculation has also developed by leaps and bounds. Compared with traditional methods, deep learning technology can extract deep semantics and obtain richer feature exp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More