System and method for automatically splitting English generalized phrase

Abstract

The invention relates to a system and a method for automatically splitting English generalized phrases, wherein the system comprises a phrase input module, a phrase classification module, a probability model module based on linguistics rules and a machine learning model module based on text classification; the phrase input module is used for inputting a large amount of phrases separated from the text of one field; the phrase classification module is used for carrying out classification to each input phrase and putting simple phrases into a simple phrase table; the probability model module based on linguistics rules is used for carrying out one-by-one splitting to each classified generalized phrases; and the machine learning model module based on text classification is used for carrying outfurther splitting to generalized phrases which can not be splitted accurately in the probability model module based on linguistics rules.

Description

A system and method for automatically splitting English compound phrases technical field The invention relates to the fields of natural language processing, ontology learning, and text mining, in particular to a system and method for automatically splitting English compound phrases. Background technique The ultimate goal of natural language processing is to enable computers to use natural language as correctly and effectively as humans. However, there is still a long way to go due to the following two challenges: one is the polysemy of natural language; the other is the need for a lot of background knowledge. Human language is quite fuzzy at various levels, including: lexical level, syntactic level, semantic level, and various language-specific structures and grammars; in order for computers to correctly process natural language, we may need to provide more than Millions of lexicons, syntactic knowledge, and more complex other information about the semantics, structure, a...

AI Technical Summary

Problems solved by technology

At present, there is no better solution for this kind of problem

Images