Sequence segmentation method and device and computer readable storage medium
A sequence and slicing technology, which is applied in the field of sequence segmentation methods, equipment and computer-readable storage media, can solve the problem of low effectiveness of sequence segmentation, and achieve the effect of improving effectiveness and ensuring effectiveness
Pending Publication Date: 2021-10-29
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, in the above process of sequence segmentation, due to the fact that the combination of sequence labeling results of each fine-grained segmentation unit in the sequence to be segmented is invalid, for example, "O, I-tag, I-tag", thus, the sequence Segmentation is less effective
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0048] In order to make the present application, the present application will be further described in detail below with reference to the accompanying drawings, and the embodiments described will not be considered in the limitation of the present invention. All other embodiments obtained under the premise of creative labor belong to the scope of this application.
[0049] In the following description, "some embodiments" describe the subset of all possible embodiments, but it can be understood that "some embodiments" may be the same subset or different subset of all possible embodiments, and It can be combined with each other without conflict.
[0050] All technical and scientific terms used herein are commonly understood by those skilled in the art, unless otherwise defined. The terms used herein are merely intended to describe the present application, not to limit the invention.
[0051] The nouns and terms involved in the present application embodiment will be described in the pr...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a sequence segmentation method and device and a computer readable storage medium. The method comprises the steps that a to-be-segmented sequence comprising n segmentation units is obtained, and n is an integer larger than 1; performing sequence segmentation on the n segmentation units to obtain a candidate segmentation sequence score set corresponding to the to-be-segmented sequence; wherein the candidate segmentation sequence score set is a set formed by candidate segmentation sequence scores corresponding to each candidate segmentation sequence, all slices in each candidate segmentation sequence form a sequence to be segmented, and the candidate segmentation sequence scores are combinations of all slice scores corresponding to all the slices; obtaining the highest candidate segmentation sequence score in the candidate segmentation sequence score set; and determining the candidate segmentation sequence corresponding to the highest candidate segmentation sequence score as a sequence segmentation result of the to-be-segmented sequence. By means of the method and device, the effectiveness of sequence segmentation in natural language processing can be improved.
Description
Technical field [0001] The present application relates to natural language processing techniques in artificial intelligence, and in particular, there is a sequence-cutting method, a device and computer readable storage medium. Background technique [0002] The sequence segmentation refers to the process of combining the individual fine granular sequences in the sequence of sequences into a coarse granular segmentation unit, which is the basic task in natural language processing; through sequence separation, it is possible to improve the execution efficiency of information processing. However, it is also possible to play an aid for information processing. [0003] In general, in order to achieve sequence separation of the sequence of sequences, each fine-grained docking unit in the sequence of sequences is typically labeled, and the sequence labeling results are determined based on the sequence of each fine granular segmentation unit. Sequence sequence sequence. However, in the pr...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/33G06F40/211G06F40/253G06F40/295G06N3/04G06N3/08G06N20/00
CPCG06F16/3344G06F40/211G06F40/253G06F40/295G06N3/08G06N20/00G06N3/045
Inventor 李扬名
Owner TENCENT TECH (SHENZHEN) CO LTD