A training method, text generation method, device and electronic equipment

A training method and text technology, applied in the direction of neural learning method, text database query, unstructured text data retrieval, etc., can solve the problems of loss of information, boring chat, not considering the length of the text, etc., to meet the length requirements, To achieve the effect of length control

Active Publication Date: 2020-11-20
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As another example, in the chat system, there are also restrictions on the generation of machine replies. If it is too long, it will bring reading burden to users and reduce the product experience. If the reply is too short, it will lose information and make the chat boring.
However, none of the existing text generation methods considers the problem of limiting the length of the generated text

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A training method, text generation method, device and electronic equipment
  • A training method, text generation method, device and electronic equipment
  • A training method, text generation method, device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0040] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of the present specification shall have ordinary meanings understood by those skilled in the art to which the present disclosure belongs. "First", "second" and similar words used in one or more embodiments of the present specification do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements or items appearing before the word include the elements or items listed after the word and their equivalents, without excluding other elements or items.

[0041] As mentioned in the back...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

One or more embodiments of this specification provide a training method, a text generation method, a device, and an electronic device; the training process adopts the Teacher-Student training framework, and is implemented in the form of joint training of a teacher-generated model and a student-generated model. The teacher generation model is a general text generation model, which is used for the student generation model to learn its text generation method; the student generation model introduces the first length control vector used to control the maximum length of the output text, and the control vector used to control the output text The minimum length of the second length control vector, through the first length control vector and the second length control vector to train the ability of the student generation model to control the length of the output text; based on the reinforcement learning method, the teacher generation model and the student generation model are obtained through the return value The joint loss and train the student generative model to get a generative model with controllable output text length, which is used to generate output text with controllable length.

Description

technical field [0001] One or more embodiments of this specification relate to the technical field of natural language processing, and in particular to a training method, a text generation method, an apparatus, and an electronic device. Background technique [0002] Text generation is a widely used natural language processing technology that can be applied to many natural language processing tasks, such as question answering systems, chat systems, article summary generation systems, and so on. In some application scenarios, there is a requirement to limit the length of the generated text. For example, in the news summary scenario, due to the limitations of page size and display typesetting, the generated news summary is required to be neither too short nor too long. If it is too short, there are too many blank spaces and it is not beautiful, and if it is too long, the text cannot be displayed. For another example, in the chat system, there are also restrictions on the gener...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/08G06N3/04G06F16/33G06F16/332G06F16/34
CPCG06N3/08G06F16/3347G06F16/3329G06F16/345G06N3/045
Inventor 梁忠平温祖杰
Owner ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap