Check patentability & draft patents in minutes with Patsnap Eureka AI!

Text generation method and device and electronic equipment

A text and input text technology, applied in the field of natural language processing, can solve problems such as inaccurate text and output, and achieve the effect of improving accuracy

Active Publication Date: 2020-08-14
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF12 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing language model does not consider the above continuous content output, so when performing the task of continuous content output, the generated text is not accurate enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text generation method and device and electronic equipment
  • Text generation method and device and electronic equipment
  • Text generation method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0026] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of the present specification shall have ordinary meanings understood by those skilled in the art to which the present disclosure belongs. "First", "second" and similar words used in one or more embodiments of the present specification do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements or items appearing before the word include the elements or items listed after the word and their equivalents, without excluding other elements or items. Words such as "connected" or "con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

One or more embodiments of the invention provide a text generation method and device, and electronic equipment. The invention discloses a scheme of one or more embodiments of the specification. The text generationg method includes: designing and constructing a text generation model, wherein the text generation model comprises an encoder and a decoder; based on an encoder-decoder structure, enabling the encoder to encode the input text; based on a self-attention mechanism, correspondingly generating the self-attention characteristics of each word included in the input text to determine the probability that the output word comes from the input text; and in combination with the self-attention characteristics generated by the encoder in the current step and the self-attention characteristics generated by the decoder in the previous step, determining the probability that the output word comes from the dictionary and the influence of the output word in the previous step on the output probability of the output word in the current step, and further gradually outputting the output word by the decoder to finally obtain an output text.

Description

technical field [0001] One or more embodiments of this specification relate to the technical field of natural language processing, and in particular, to a text generation method, device, and electronic equipment. Background technique [0002] Text generation is a widely used natural language processing technology, which can be applied in many natural language processing tasks, such as question answering system, chat system creation and so on. In many application scenarios, there is a situation where continuous content output is performed with a part of the input text, that is, the generated output text is a continuous segment of the input text. For example, in reading comprehension tasks, the output text should often be a continuous text segment in the input text. However, the existing language models do not take into account the above continuous content output, so when performing the task of continuous content output, the generated text is not accurate enough. Contents o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/34G06F16/332G06F40/205G06F40/289G06N3/04G06N3/08
CPCG06F16/34G06F16/345G06F16/3329G06F40/205G06F40/289G06N3/08G06N3/045
Inventor 梁忠平温祖杰张琳
Owner ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com