A Data Element Recognition Method Based on Logic and Statistical Technology

Abstract

The invention relates to the technical field of data identification, and particularly discloses a method for identifying data elements on the basis of logic and statistic technologies. The method includes enabling clients to submit data processing requests for to-be-tested language materials, counting length characteristics of data in data element libraries and lexical rules of data element structures by the aid of computers, classifying the data according to the length characteristics of the data, respectively summarizing the lexical rules of different categories of data element structures, performing word segmentation and part-of-speech tagging processing on the data in the to-be-tested language materials by the aid of lexical analysis tools, and extracting candidate data elements from the to-be-tested language materials by the aid of the length characteristics and the lexical rules; counting distribution conditions of the candidate data elements in the to-be-tested language materials, and dividing the candidate data elements into a data element category and a non-data element category step by step; respectively checking the candidate data elements under the matching effects of sub-string filter algorithms and phrases, filtering vocabulary activeness, further computing domain relevancy and sorting the phrases according to the domain relevancy from high to low. The method has the advantage that the data elements can be automatically identified by the aid of the method.

Description

technical field [0001] The invention relates to the technical field of data identification, in particular to a data element identification method based on logic and statistical techniques. Background technique [0002] Data Element: Also known as a data type, a data unit described by a series of attributes such as definition, identification, representation, and allowable values. In a certain context, it is usually used to construct a semantically correct, independent and unambiguous specific conceptual semantic information unit, which is used to standardize and classify industry data in a unified name, type, and value; the purpose is to establish a Various types of industry database construction and database integration, as well as data integration, exchange, sharing, service and application of data standardization needs. [0003] The 6W principle is a method of thinking and solving problems proposed by the British writer Kipling, who won the Nobel Prize for Literature, nam...

AI Technical Summary

Problems solved by technology

[0005] The technical problem solved by the present invention is to provide a data element identification method based on logic and statistical technology. This method solves the problem of automatic identification of data elements and lays a good foundation for the later classification of data elements.

Images