Unlock instant, AI-driven research and patent intelligence for your innovation.

Text processing method and network model training method based on attention mechanism optimization

A text processing and attention technology, applied in the field of text processing, can solve the problems of low processing efficiency and poor utilization of computing resources in the text processing process

Active Publication Date: 2022-07-12
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in some scenarios, the text processing process has low processing efficiency and poor utilization of computing resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text processing method and network model training method based on attention mechanism optimization
  • Text processing method and network model training method based on attention mechanism optimization
  • Text processing method and network model training method based on attention mechanism optimization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

[0023] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the present disclosure. The terms "comprising", "comprising" and the like as used herein indicate the presence of stated features, steps, operations and / or components, but do not preclude the presence or addition of one or more other features,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a text processing method and device based on attention mechanism optimization, a network model training method and device, equipment, a medium and a product, and relates to the technical field of artificial intelligence, in particular to the technical field of natural language processing and deep learning. According to the specific implementation scheme, M text statements in a to-be-processed text are divided to obtain N statement groups, N is an integer larger than 0, M is an integer not smaller than N, and each statement group of the N statement groups comprises at least one text statement; determining attention distribution characteristics of at least one text statement in each statement group; and performing parallel operation based on the attention distribution characteristics of each statement group to obtain an output result for the to-be-processed text.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, in particular to the technical field of natural language processing and deep learning, and can be applied to scenarios such as text processing. Background technique [0002] Text processing is widely used in language understanding tasks, question answering tasks, machine translation, natural language reasoning and other scenarios. However, in some scenarios, the text processing process has the phenomenon of low processing efficiency and poor utilization of computing resources. SUMMARY OF THE INVENTION [0003] The present disclosure provides a text processing method optimized based on attention mechanism, a network model training method and apparatus, equipment, medium and product. [0004] According to an aspect of the present disclosure, there is provided a text processing method optimized based on an attention mechanism, including: dividing M text sentences in the t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/211G06F40/30G06N3/04G06N3/08
CPCG06F40/211G06F40/30G06N3/084G06N3/045G06N3/044Y02D10/00
Inventor 李敏曾锦乐吴志华蓝翔邢冯刘益群
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD