Word segmentation processing method and device, mobile terminal and computer readable storage medium

Abstract

The invention discloses a word segmentation processing method and device, a mobile terminal and a computer readable storage medium. The method comprises the following steps of: when a to-be-segmentedstatement is obtained, determining a target language type corresponding to the to-be-segmented statement; respectively first feature vectors corresponding individual characters, second feature vectorscorresponding to two words and third feature vectors corresponding to proper nouns in the to-be-segmented statement; determining current fourth feature vectors of the individual characters accordingto the first feature vectors, the second feature vectors and the third feature vectors; and carrying out word segmentation on the to-be-segmented statement according to a preset Chinese character label transfer matrix and the current fourth feature vectors of the individual characters. According to the method, word segmentation is carried out on to-be-segmented statements according to target language types corresponding to the to-be-segmented statements, so that the correctness of carrying out word segmentation on to-be-segmented statements in various language types is improved; and proper resources can be loaded according to requirements, so that storage spaces of mobile terminals are saved and the user experience is improved.

Description

technical field [0001] The present invention relates to the technical field of word segmentation processing, in particular to a word segmentation processing method, device, mobile terminal and computer-readable storage medium. Background technique [0002] With the continuous development of computer technology, word segmentation technology has been widely used in search engines, machine translation, speech synthesis, automatic summarization and other fields. Among them, the word segmentation technology refers to the technology of dividing a sentence or a paragraph of text into words one by one. [0003] In the prior art, a word segmentation model based on statistics or a word segmentation model based on a dictionary is usually used to perform word segmentation processing on the sentence to be word segmented. However, the current word segmentation model is often obtained after training on corpus of a specific language, so when performing word segmentation processing on other...

AI Technical Summary

Problems solved by technology

However, the current word segmentation model is often obtained after training the corpus of a specific language, so when performing word segmentation processing for other languages, the accuracy is low and the user experience is poor

Images