Word segmentation method, device and equipment based on multilevel dictionary and readable storage medium
Patent Information
- Authority / Receiving Office
- CN Β· China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SUZHOU UNIV
- Publication Date
- 2021-01-12
Smart Images
Figure 1 
Figure 2 
Figure 3
Abstract
Description
technical field
[0001] The present application relates to the field of computer technology, in particular to a word segmentation method, device, device and readable storage medium based on a multi-level dictionary. Background technique
[0002] Chinese word segmentation is a process of dividing an input sentence into word sequences. An additional dictionary is usually provided for the model to alleviate the problem of insufficient training data for manual annotation. However, the current word segmentation schemes all use single-level dictionaries, ignoring the problem that different words in the dictionary have different word-forming probabilities, and also ignoring the problem that the same string becomes a word in one field but not in another field, resulting in The word segmentation effect of the word segmentation model is poor.
[0003] The word segmentation method based on a single-level dictionary also has the problem of little influence on the actual word segmentati...