Science and technology project duplicate checking method for automatically realizing field weight allocation based on deep learning algorithm

Abstract

The invention provides a science and technology project duplicate checking method for automatically realizing field weight allocation based on a deep learning algorithm, which comprises the followingsteps: extracting a target text from a specified field of a target file, and segmenting the target text into keywords; retrieving a to-be-queried file containing a single keyword in a database, and setting a weight value of the keyword; utilizing a neural network to establish a weight evaluator to evaluate and sort the to-be-checked files containing the keywords; selecting a to-be-queried file with the highest relevancy, and extracting a comparison text from a specified field of the to-be-queried file; establishing a comparison matrix, and calculating the similarity between the target text andthe comparison text according to the scale of the sub-matrix; according to the science and technology project duplicate checking method for automatically realizing field weight distribution based onthe deep learning algorithm, learning training is conducted on related samples through the neural network, and after training is completed, a file similarity comparison (duplicate checking) task can be efficiently and rapidly completed.

Description

technical field [0001] The invention belongs to the technical field of data retrieval and comparison, and in particular relates to a scientific and technological item checking method for automatically realizing field weight distribution based on a deep learning algorithm. Background technique [0002] At present, the duplication rate detection of papers / projects mainly uses detection systems such as PaperPass, Wanfang, and HowNet, and uses string matching algorithms to calculate the similarity ratio of the files to be detected relative to the target files in the file library. The string matching algorithm uses a piece of text to be completely consistent as the standard for measuring the repetition of papers. However, due to the complexity of the Chinese language and the diversity of expressions, for two paragraphs of text with the same substantive content, there are often some meaningless gaps in the middle. "Stop words" or function words or situations such as subject-verb-o...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a method for plagiarism checking of scientific and technological items based on a deep learning algorithm that automatically realizes field weight distribution, aiming to solve the problem of low efficiency of plagiarism checking in the prior art

Images