Parallel corpus aligning method and device

Abstract

The invention discloses a parallel corpus aligning method. The method comprises the following steps: converting all the original text sentences in an original text and all the translated text sentences in a translated text into characters with a same encoding manner; carrying out word segmentation on the converted original text sentences in the original text and removing stop words therein so as to obtain content words; obtaining all the translated items of each content word of each original text sentence; matching all the translated items of each content word of each original text sentence in the converted translated text sentences of the translated text so as to obtain the similarity between each word content of each original text sentence and the translated text sentences; matching each original text sentence with the translated text sentences according to the similarity between each word content of each original text sentence and the translated text sentences so as to obtain the similarity between each original text sentence and the translated text sentences; and matching and aligning the translated text sentences having the highest similarity with the original text sentences with the original text sentences. The invention furthermore discloses a parallel corpus aligning device. According to the method and device, the problem of aligning between the original texts and the translated texts is solved.

Description

Technical field [0001] The present invention relates to the technical field of translation, in particular to a method and device for parallel corpus alignment. Background technique [0002] Parallel corpora plays a fundamental role in many fields such as machine translation, auxiliary translation, semantic disambiguation and dictionary compilation. The alignment of parallel corpora refers to the correspondence between the original text and the translation according to different division granularities to form a standardized language pair. The unit of corpus alignment has different granularities from large to small, such as chapters, paragraphs, sentences, and words. The smaller the granularity of parallel corpus, the richer the language information it provides and the greater the application value. [0003] Generally speaking, if the corpus is aligned by chapter or paragraph, the original text and the target text can be aligned in order. However, aligning the original text and tar...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to overcome the above-mentioned deficiencies in the prior art, and provide a method for aligning parallel corpora, which solves the problem of aligning original and translated texts based on the similarity of content words

[0005] Another purpose of the embodiments of the present invention is to overcome the above-mentioned deficiencies in the prior art, and provide a device for aligning parallel corpora, which solves the problem of aligning original and translated texts based on the similarity of content words

Images