Dependency syntactic analysis method fusing multi-strategy data enhancement under low-resource condition

Abstract

The invention relates to a dependency syntactic analysis method fusing multi-strategy data enhancement under a low-resource condition, and belongs to the field of natural language processing. The method comprises the following steps: constructing homomorphic synonym dictionary of Thai, Vietnamese and English; carrying out synonym replacement on small-scale UD (Universal Dependencies treebanks) data sets of three languages by utilizing a synonym dictionary so as to expand training data; and performing mixup on original words and synonyms in the training data in different stages of model training by utilizing various mix data enhancement strategies to generate virtual new words for subsequent training. According to the method, various data enhancement strategies are provided for the low-resource-dependency syntactic analysis problem. According to the method, training data are effectively expanded through synonym replacement, and the problem of unknown words is relieved. Through a plurality of mixup data enhancement strategies, the problem of model overfitting is effectively relieved, and the generalization ability of the model is improved.

Description

technical field [0001] The invention relates to a dependency syntax analysis method for fusion multi-strategy data enhancement under low resource conditions, and belongs to the field of natural language processing. Background technique [0002] In natural language processing, dependency parsing aims to identify syntactic dependencies between words in a sentence. Dependency syntax can provide syntactic features for tasks such as information extraction, automatic question answering, and machine translation to improve model performance. [0003] Although the existing dependency parsing methods have carried out a lot of research work on feature encoding, dependency scoring and decoding, they have also effectively improved the effect of dependency parsing. However, under low-resource conditions, the performance of existing models and methods is difficult to obtain good analysis results. This problem is especially evident in low-resource languages ​​such as Thai and Vietnamese. ...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a dependency syntactic analysis method that integrates multi-strategy data enhancement under low resource conditions to be used for dependency syntactic analysis under low resource conditions such as Thai, Vietnamese, and small-scale English. Problems such as too high and model overfitting lead to poor results of dependency syntax analysis

Images