85 results about "Phrase extraction" patented technology

A syntactic analysis and hierarchical phrase model based machine translation system and method are provided. The machine translation system includes a word alignment module, a phrase extraction module, a gender syntactic annotation module, a syntactic based noncontiguous phrase abstract module, a noncontiguous phrase based translation module and an evaluation module. The machine translation system and method performs syntactic analysis based on a common contiguous phrase based machine translation model, and extracts a syntactic based noncontiguous phrase rule set from a bilingual aligned text, so as to address and issue of noncontiguous fixed custom in context of a whole sentence, and to comply with syntactic features of a language, translation is performed based on the noncontiguous phrase rule set and the phrase aligned table, and the translation results are evaluated based on the evaluation model, thereby improving the translation result.

An information retrieval system uses phrases to index, retrieve, organize and describe documents. Phrases are extracted from the document collection. Documents are the indexed according to their included phrases, using phrase posting lists. The phrase posting lists are stored in an cluster of index servers. The phrase posting lists can be tiered into groups, and sharded into partitions. Phrases in a query are identified based on possible phrasifications. A query schedule based on the phrases is created from the phrases, and then optimized to reduce query processing and communication costs. The execution of the query schedule is managed to further reduce or eliminate query processing operations at various ones of the index servers.

The purpose of the present invention is to create a dictionary for monitoring text information such that it is possible to achieve high-precision detection compared to prior art. A feature degree calculation unit (3) compares the statistics of a positive example group and a negative example group, and calculates the degree by which a given phase appears in the positive example group as the feature degree. A usefulness degree calculation unit (21) calculates a usefulness degree by using indices pertaining to the length of the phrase, the frequency at which the phrase appears within the positive example group, and the inclusion relationship between phrases for each phrase extracted by means of a phrase extraction unit (1). A detection condition determination unit (22) uses the usefulness degree calculated by means of the usefulness degree calculation unit (21) and the feature degree calculated by means of the feature degree calculation unit (3) to evaluate the appropriateness of each phrase as a detection condition by means of the product of the usefulness degree and the feature degree, and determines that the phrase is appropriate as a detection condition when the value of the product is greater than a threshold value.