Unlock instant, AI-driven research and patent intelligence for your innovation.

Text processing method, computer readable storage medium and computer device

A text processing and text technology, applied in the field of text processing, can solve the problem of poor knowledge learning ability of pre-trained language models, and achieve the effect of improving knowledge learning ability

Active Publication Date: 2022-06-24
ALIBABA (CHINA) CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] An embodiment of the present invention provides a text processing method, a computer-readable storage medium, and a computer device, so as to at least solve the technical problem of the poor knowledge learning ability of the pre-trained language model in the text in the related art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text processing method, computer readable storage medium and computer device
  • Text processing method, computer readable storage medium and computer device
  • Text processing method, computer readable storage medium and computer device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] According to an embodiment of the present invention, a method embodiment of a text processing method is also provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and , although a logical order is shown in the flowcharts, in some cases steps shown or described may be performed in an order different from that herein.

[0041] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. figure 1 A hardware structure block diagram of a computer terminal for implementing a text processing method is shown. like figure 1 As shown, the computer terminal 10 may include one or more processors (102a, 102b, . means), memory 104 for storing data, and transmission means for communication functions. In addition, may also include: display, input / output ...

Embodiment 2

[0136] According to an embodiment of the present invention, an apparatus for implementing the above text processing method is also provided, Figure 7 is a structural block diagram of an optional text processing apparatus provided according to an embodiment of the present invention, such as Figure 7 As shown, the apparatus includes: a first obtaining module 702, a first adding module 704, a first searching module 706, a first labeling module 708 and a first training module 710, which will be described separately below.

[0137] The first acquisition module 702 is used to acquire multiple sets of sample data, wherein the multiple sets of sample data include sample texts; the first addition module 704 is connected to the above-mentioned first acquisition module 702 and is used for the first target word in the sample texts. Add a mask to obtain the target text; the first search module 706 is connected to the above-mentioned first adding module 704 and is used to search for...

Embodiment 3

[0147] Embodiments of the present invention also provide a computer-readable storage medium. Optionally, in this embodiment, the above-mentioned computer-readable storage medium may be used to store the program code executed by the text processing method provided in the above-mentioned Embodiment 1.

[0148] Optionally, in this embodiment, the computer-readable storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group.

[0149] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for performing the following steps: acquiring multiple sets of sample data, wherein the multiple sets of sample data include sample text; Add a mask to a target word to obtain a target text; find a second target word from the sample text; label the recognition weight of the word segmentation included in the sample text, wherein the recognition...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a text processing method, a computer-readable storage medium and computer equipment. Wherein, the method includes: obtaining multiple sets of sample data, wherein the multiple sets of sample data include sample text; adding a mask to the first target word in the sample text to obtain the target text; finding the second target word from the sample text; Mark the recognition weights of the participles included in the sample text, wherein the recognition weight of the second target word is smaller than the recognition weights of other participles except the second target word; the recognition weights of the participles included in the target text and the sample text are used for machine Train to get the object converter model. The invention solves the technical problem of the poor knowledge learning ability of the pre-trained language model in the text in the related art.

Description

technical field [0001] The present invention relates to the technical field of text processing, and in particular, to a text processing method, a computer-readable storage medium, and a computer device. Background technique [0002] Pre-trained language models (PLM) are used to obtain general knowledge from text. [0003] In the related art, there are many kinds of pre-trained language models for text processing, including: pre-trained language representation model (Bidirectional Encoder Representation from Transformers, BERT), RoBERTa and generative pre-training model (Generate Pre-Training Model) , GPT), etc. Although these pre-trained language models can greatly improve the performance of many natural language processing tasks, there is a problem that pre-trained language models have poor knowledge learning ability in texts. [0004] For the above problems, no effective solution has been proposed yet. SUMMARY OF THE INVENTION [0005] Embodiments of the present inven...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/289G06F40/216G06F16/33
Inventor 王存翔罗福莉李炎洋许润昕黄松芳黄非
Owner ALIBABA (CHINA) CO LTD