Automatic extraction and filtration method for Chinese-English phrase translation pairs

Abstract

The present invention provides an automatic abstracting and filtering method in Chinese-English phrase translation. The method of the invention comprises the following steps: extracting the characteristic information which divides the language block and filters the candidate phrase to original Chinese-English double-language sentence pair; confirming the language block division anchor point according to different characteristic information, dividing the original Chinese-English sentence pair to a plurality of single language blocks; extracting the candidate phrase in the language block with the word aligning information of original Chinese-English double-language sentence pair; and filtering the generated candidate phrase according to the characteristic information of generation frequencyof candidate phrase for generating the required phrase pair. The invention adopts the phrase abstraction in the traversing language block and is especially useful for the indefinite expanding of empty word thereby effectively settling the requirement to the storing space caused by the overgreat extraction amount of phrase, and effectively filtering many noise phrase. The invention can generate a plurality groups of phrases directly according to the fixation word alignment of present sentence pair thereby increasing the recalling rate of phrase pair under the precondition of satisfying the precision.

Description

A method for automatic extraction and filtering of Chinese-English phrase translation pairs technical field The invention belongs to the field of natural language processing, in particular to methods for statistical machine translation, cross-language information retrieval and bilingual phrase automatic extraction and filtering. Background technique With the advent of the globalized information age, how to overcome language barriers is becoming more and more serious. Using computers to realize automatic translation between different languages ​​has become a common problem faced by all mankind. At present, statistical methods occupy a dominant position in machine translation research, and among statistical methods, phrase-based translation models are more mature. The basic idea of ​​the phrase-based statistical machine translation method is to take the phrase as the basic unit of translation. Because phrases contain information about the selection of translated words and t...

AI Technical Summary

Problems solved by technology

And we clearly know that, firstly, the accuracy rate of syntactic tree generation itself is a problem, and secondly, the constraints of syntactic tree are too strict to meet the requirement of recall rate, so in most syntactic systems, all phrases are actually retained Yes, using only syntactic knowledge to provide reordering information

Images