KNN-based text classification method

Abstract

The invention discloses a KNN-based text classification method which is suitable for nuclear safety software verification and reliability verification. The KNN-based text classification method comprises a training process processing step and a test process processing step: representing training sample data sets by information of original texts and all the titles in the texts; and constructing two DBM models according to characteristic hierarchical structures in the texts from shallow to deep, extracting and storing deep characteristics with low dimensionality and high discrimination, and determining the categories of to-be-tested texts through considering the contribute brought from text titles to the similarity calculation via proper weights in the test process. According to the method disclosed in the invention, information of the text titles are fully utilized, the classification performance, relative to the condition of taking the shallow characteristic vectors as training sets, is remarkably improved, and meanwhile, the storage demand and online calculation amount are reduced at the same time, so that the problem of characteristic vector high-dimensionality disaster is solved and the classification correctness is improved; and the method can be used for the matching of rules in safety level software reliability evaluation analysis and the establishment of a failure mode library.

Description

technical field [0001] The invention relates to a KNN-based text classification method, in particular to nuclear safety level software verification and reliability verification. Background technique [0002] In the process of nuclear safety software development, a large number of technical documents are generated, and with the iterative development of software, the technical documents are constantly updated, for each item in each version of the document (such as requirements or design items) , according to the nuclear power-related software standards, the requirements of the evaluation rules must be met. Therefore, it is an urgent problem for quality personnel to quickly and accurately determine the relationship between items and rules. In addition, in the entire life cycle of software product development, in order to detect potential failures early, iteratively perform failure mode and effect analysis (FMEA) at each stage, establish a failure mode library and be able to aut...

AI Technical Summary

Problems solved by technology

[0005] In addition, as a technical document in the field of nuclear power, its compilation must conform to the standard specifications, especially the titles of the same kind have a high degree of generalization and similarity. Important information that large loss titles bring to classification

Images