Supercharge Your Innovation With Domain-Expert AI Agents!

Text processing method and device, computer equipment and storage medium

A text processing and text technology, applied in the computer field, can solve the problems of slow training speed and large filling amount of text processing models, and achieve the effect of improving training speed and reducing calculation amount.

Pending Publication Date: 2022-05-17
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since this method needs to pad all sample texts to the maximum length, resulting in a large amount of padding, which in turn leads to slow training of the text processing model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text processing method and device, computer equipment and storage medium
  • Text processing method and device, computer equipment and storage medium
  • Text processing method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0099] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the following will further describe the embodiments of the present application in detail in conjunction with the accompanying drawings.

[0100] It can be understood that the terms "first", "second" and the like used in this application may be used to describe various concepts herein, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, a first network layer could be termed a second network layer, and, similarly, a second network layer could be termed a first network layer, without departing from the scope of the present application.

[0101] Wherein, at least one refers to one or more than one. For example, at least one network layer may be any integer number of network layers greater than or equal to one, such as one network layer, two network la...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a text processing method and device, computer equipment and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: acquiring a plurality of sample texts and a plurality of reference lengths; forming a sample set by the sample texts corresponding to the same reference length, wherein the reference length corresponding to the sample text is not less than the length of the sample text and is closest to the length of the sample text in a plurality of reference lengths; filling the reference length corresponding to the sample set with the sample texts smaller than the reference length corresponding to the sample set in each sample set; and training the text processing model in parallel based on the allocated sample set through each processing node in the plurality of processing nodes. Due to the fact that the filling amount of the sample text is small, and the text processing model can be trained in parallel through the multiple processing nodes, parallel training of the text processing model is guaranteed, meanwhile, the calculation amount is reduced, and the training speed of the text processing model can be increased.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a text processing method, device, computer equipment and storage medium. Background technique [0002] With the development of computer technology and the advancement of artificial intelligence technology, when training text processing models, it is usually necessary to input multiple sample texts together into the text processing model to train the text processing model during the training process, thereby speeding up the training speed. It is necessary to ensure that the lengths of the plurality of sample texts are consistent. [0003] In related technologies, after obtaining a plurality of sample texts, determine the maximum length among the lengths of the multiple sample texts, fill the sample texts smaller than the maximum length to the maximum length, and then train based on the filled multiple sample texts. Text processing model. However, since this method ne...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/166G06K9/62G06N3/04G06N3/08
CPCG06F40/166G06N3/08G06N3/045G06F18/214
Inventor 弓静
Owner TENCENT TECH (SHENZHEN) CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com