Controllable text generation method based on natural language reasoning type under condition of few samples

A natural language and text technology, which is applied in the field of controllable text generation, can solve the problems of unreliable results, unconsidered solutions, and a large number of problems, and achieves the effect of improving the accuracy of text generation.

Pending Publication Date: 2022-05-20
SHANGHAI JIAO TONG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] There is a flaw in the above related research techniques: a large amount of labeled data is required to train the deep learning model
[0015] (1) The related research on controllable text generation of natural language reasoning type does not consider the solution under the condition of few samples
[0016] (2) The best-performing method for automatically generating templates in paradigm learning, the results on the verification set are unreliable when used for the problem of (1)
[0017] (3) The existing demonstration learning method does not make specific vector adjustments according to the current domain and problem when selecting examples

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Controllable text generation method based on natural language reasoning type under condition of few samples
  • Controllable text generation method based on natural language reasoning type under condition of few samples
  • Controllable text generation method based on natural language reasoning type under condition of few samples

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. This embodiment is implemented on the premise of the technical solution of the present invention, and provides a detailed implementation manner and a specific operation process, but the protection scope of the present invention is not limited to the following embodiments.

[0053] like figure 1 As shown, this embodiment provides a controllable text generation method based on natural language reasoning type under a few samples. The method uses a controllable text generation model to convert the premise p into the hypothesis h corresponding to the specific logical relationship c, and generate all the The controllable text, the controllable text generation model includes a retriever and a generator, the retriever retrieves the most similar example to the premise p from the training set, the premise p, the logical relationship c and the example All ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a controllable text generation method based on a natural language reasoning type under the condition of few samples, and the method comprises the steps: converting a premise p into a hypothesis h corresponding to a specific logic relation c through a controllable text generation model, and generating a controllable text, the controllable text generation model comprises a retriever and a generator, the retriever retrieves and obtains an example most similar to the premise p from a training set, the premise p, the logic relation c and the example are all subjected to normative processing through a pre-constructed template, and the generator generates and obtains a final hypothesis h by adopting a dynamic demonstration algorithm based on the normative premise p, the logic relation c and the example. Compared with the prior art, the method has the advantages of being high in generation accuracy, capable of better adapting to current tasks and fields and the like.

Description

technical field [0001] The invention relates to the field of natural language processing, in particular to a controllable text generation method based on a natural language inference type under few samples. Background technique [0002] The natural language inference type of text generation is given a premise p, a logical relationship c, to generate a hypothesis h that conforms to the logical relationship c. There are three types of logical relationship c: [0003] Entailment: A hypothesis can be deduced from a premise to be true. [0004] Neutral: The assumption cannot be deduced from the premises to be true or false. [0005] Contradiction: A false assumption can be deduced from a premise. [0006] A simple example is the premise p: Xiao Ming is playing basketball. If it is implication, the hypothesis can be: Xiao Ming is moving. If it is neutral, the hypothesis can be: Xiaoming likes Xiaohong. If it is contradictory, the hypothesis can be: Xiao Ming is playing footb...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/186G06F40/226G06F40/216G06N5/04G06N3/08
CPCG06F40/186G06F40/226G06F40/216G06N5/04G06N3/08
Inventor 李恺健朱其立
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products