A multi-strategy English long sentence segmentation method for machine translation

Abstract

The invention relates to a machine translation-oriented multi-strategy English long sentence segmentation method and device, belonging to the technical field of natural language processing machine translation. The method includes two steps of training and actual use; for the training step: first prepare the English training corpus and preprocess it; then perform feature extraction on the corpus, including extracting dependent syntactic features, part-of-speech tagging features, and comma position features; Finally, create a feature template to train the CRF model; at the same time, design a number of rules that can handle simple phenomena more accurately; for the actual use steps, first perform feature extraction on long English sentences to be processed, and the extracted features are the same as the training steps; then use rule algorithms respectively And the CRF model to mark the position of the comma; then add a comma to the marked position to complete the segmentation. Compared with the existing technology, by adopting the strategy of combining rules and statistics, it can effectively and accurately segment English long sentences and improve the quality of machine translation.

Description

technical field [0001] The invention relates to a pre-translation preprocessing method for machine translation, in particular to a machine translation-oriented multi-strategy English long sentence segmentation method, which belongs to the technical field of natural language processing machine translation. Background technique [0002] Today, the Internet is very developed and spread all over the world. With the help of the Internet, people from different nationalities and speaking different languages ​​can share information anytime and anywhere, and people are increasingly eager to obtain useful information on the Internet quickly and smoothly. However, in the face of the vast amount of information on the Internet today, traditional human translation seems powerless. Therefore, under such a background, machine translation technology has a huge market, and scholars from various countries have also done a lot of research work in this field. [0003] In recent years, machine ...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the problem that the existing rule-based sentence segmentation method has too little coverage of language phenomena, and the existing machine learning-based method can only use commas in the sentence to segment, and proposes a A Novel Multi-Strategy English Long Sentence Segmentation Method for Machine Translation

Images