Machine-translation-oriented multi-strategy segmentation method and device of English long sentence

Abstract

The invention relates to a machine-translation-oriented multi-strategy segmentation method and device of an English long sentence, and belongs to the technical field of natural language processing machine translation. The method comprises two steps of training and practical use, wherein the training step comprises the following specific steps: firstly, preparing and preprocessing English training corpuses; then, carrying out characteristic extraction on the corpuses, wherein the characteristic extraction comprises the extraction of dependency syntax characteristics, the extraction of part-of-speech tagging characteristics, the extraction of comma position characteristics and the like; and finally, creating a characteristic template training CRF (Conditional Random Field) model, and simultaneously designing a plurality of rules which can relatively accurately process simple phenomena. The practical use step specifically comprises the following steps: firstly, carrying out the characteristic extraction on the English long sentence to be processed, wherein the extracted characteristics are the same with the extracted characteristics in the training step; then, independently using a rule algorithm and the CRF model to label a comma position; and finally, adding a comma on the labeled position to finish segmentation. Compared with the prior art, the method and the device can effectively and accurately segment the English long sentence to improve the machine translation quality through a strategy that the rules and statistics are combined.

Description

technical field [0001] The invention relates to a pre-translation preprocessing method for machine translation, in particular to a machine translation-oriented multi-strategy English long sentence segmentation method, which belongs to the technical field of natural language processing machine translation. Background technique [0002] Today, the Internet is very developed and spread all over the world. With the help of the Internet, people from different nationalities and speaking different languages ​​can share information anytime and anywhere, and people are increasingly eager to obtain useful information on the Internet quickly and smoothly. However, in the face of the vast amount of information on the Internet today, traditional human translation seems powerless. Therefore, under such a background, machine translation technology has a huge market, and scholars from various countries have also done a lot of research work in this field. [0003] In recent years, machine ...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the problem that the existing rule-based sentence segmentation method has too little coverage of language phenomena, and the existing machine learning-based method can only use commas in the sentence to segment, and proposes a A Novel Multi-Strategy English Long Sentence Segmentation Method for Machine Translation

Images