Project duplicate checking method and system based on concurrent tasks

Abstract

The invention discloses a project duplicate checking method and system based on concurrent tasks. The method comprises four steps of carrying out the dynamic analysis on the Internet hot words and common words through the Internet technology, and forming a cloud lexicon; and matching the text information in the declaration material with a cloud word bank through a text matching method, segmentingthe declaration material into the semantic word segmentation factors, obtaining an optimal word segmentation scheme through weighted calculation, counting the word frequency and eliminating the high-frequency single words; and returning the similarity values of the current duplicate checking projects and the historical projects to the segmented word subset of the current duplicate checking projectand the segmented word subset of the historical project through a cosine similarity algorithm CosineSimilar. During the big data calculation, a high-capacity high-speed memory is utilized, the memorymanagement is reasonably used, the frequent read-write access of a hard disk is reduced, the concurrent multithreading tasks are started, the system resources are fully utilized, and the maximum frequency of a CPU is brought into play, so that the duplicate checking efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of calculation methods for judging whether declaration materials are repeated or similar to other projects in the process of project establishment, and specifically relates to a method and system for checking duplicates of projects based on concurrent tasks. Background technique [0002] In the process of project, achievement and award declaration, it is usually necessary to fill in a large number of written declaration materials. These materials will have problems such as repeated reporting and plagiarism of other people's achievements, resulting in waste of manpower and material resources. In the past, the repeated work of checking text was carried out by manual reading. As more and more project information is accumulated over time, the requirements for review work are getting higher and higher. Relevant personnel need to read a lot of project information and have a super memory. Only the ability to master...

AI Technical Summary

Problems solved by technology

[0004] Aiming at the deficiencies of the prior art, the present invention provides a method and system for item duplication checking based on concurrent tasks, which has the advantages of reducing frequent read and write access to the hard disk, making full use of system resources, etc., and solves the increasingly difficult inspection work, which is difficult In the review process, problems such as repeated reporting and plagiarism of other people's achievements are eliminated

Images