Weak supervision Chinese-Vietnamese bilingual dictionary construction method based on English pivot

Abstract

The invention relates to a weak supervision Chinese-Vietnamese bilingual dictionary construction method based on an English pivot, and belongs to the technical field of natural language processing. The method comprises the following steps of: respectively collecting monolingual corpora of Chinese, English and Vietnamese and preprocessing the corpora; aligning the Chinese word vectors to an Englishword vector sharing space based on a seed dictionary method; learning a mapping relationship between the Chinese word vectors through an adversarial network in the English word vector sharing space;and different extraction strategies are adopted to extract the Han-cross dictionary. According to the method, the accuracy of automatically constructing the Han-crossing dictionary is greatly improved. The problems that in an existing Chinese-Vietnamese bilingual dictionary construction method, parallel corpora, seed dictionaries and the like are very scarce and difficult to label, and an existingmethod is poor in construction effect are solved.

Description

technical field [0001] The invention relates to a weakly supervised Chinese-Vietnamese bilingual dictionary construction method based on an English pivot, and belongs to the technical field of cross-language natural language processing. Background technique [0002] The exchanges between China and countries along the route are becoming more and more frequent, and the issue of language translation in cross-language communication has attracted much attention. As one of the countries along the route, the exchanges between Vietnam and my country are getting closer. As a basic resource in the field of cross-language natural language processing, bilingual dictionaries have extremely important research value. The quality of bilingual dictionaries has a great impact on NLP tasks such as information retrieval, machine translation, and cross-language annotation projection. However, manual construction of large-scale Chinese-Vietnamese bilingual dictionaries requires the participatio...

AI Technical Summary

Problems solved by technology

[0005] The invention provides a weakly supervised Chinese-Vietnamese bilingual dictionary construction method based on English pivots, which is used to solve the problem that parallel corpus and seed dictionaries are very scarce and difficult to label in the existing Chinese-Vietnamese bilingual dictionary construction methods and existing methods Bad effect and other problems

Images