Method and device for parallel corpus alignment

Abstract

The invention discloses a parallel corpus aligning method. The method comprises the following steps: converting all the original text sentences in an original text and all the translated text sentences in a translated text into characters with a same encoding manner; carrying out word segmentation on the converted original text sentences in the original text and removing stop words therein so as to obtain content words; obtaining all the translated items of each content word of each original text sentence; matching all the translated items of each content word of each original text sentence in the converted translated text sentences of the translated text so as to obtain the similarity between each word content of each original text sentence and the translated text sentences; matching each original text sentence with the translated text sentences according to the similarity between each word content of each original text sentence and the translated text sentences so as to obtain the similarity between each original text sentence and the translated text sentences; and matching and aligning the translated text sentences having the highest similarity with the original text sentences with the original text sentences. The invention furthermore discloses a parallel corpus aligning device. According to the method and device, the problem of aligning between the original texts and the translated texts is solved.

Description

technical field [0001] The invention relates to the technical field of translation, in particular to a method and device for aligning parallel corpus. Background technique [0002] Parallel corpora play a fundamental role in many fields such as machine translation, assisted translation, semantic disambiguation, and lexicography. Alignment of parallel corpora refers to matching the original text and the translated text at different segmentation granularities to form a standardized language pair. The unit of corpus alignment has different granularities such as chapters, paragraphs, sentences, and words from large to small. The smaller the granularity of the parallel corpus, the richer the language information it provides and the greater its application value. [0003] Generally speaking, if the corpus is aligned by chapter or paragraph, the original text and the translation can be aligned in order. However, aligning the source text and the target text by sentences or smaller...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to overcome the above-mentioned deficiencies in the prior art, and provide a method for aligning parallel corpora, which solves the problem of aligning original and translated texts based on the similarity of content words

[0005] Another purpose of the embodiments of the present invention is to overcome the above-mentioned deficiencies in the prior art, and provide a device for aligning parallel corpora, which solves the problem of aligning original and translated texts based on the similarity of content words

Images