Unlock instant, AI-driven research and patent intelligence for your innovation.

Natural language reasoning method and system

A technology of natural language and reasoning methods, applied in the field of natural language reasoning methods and systems, can solve problems such as unsupervised, poor model interpretability, no parameters, etc., to achieve the effect of improving expression ability, promoting interaction, and enhancing performance

Inactive Publication Date: 2020-08-18
AEROSPACE INFORMATION RES INST CAS
View PDF1 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the attention mechanism is widely used in natural language reasoning models, the attention methods used in existing models are parameterless or unsupervised, the attention module is not constrained in the model, and there is no goal to guide the attention module training, leading to poor interpretability of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural language reasoning method and system
  • Natural language reasoning method and system
  • Natural language reasoning method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] The present invention provides a natural language reasoning method, such asfigure 1 shown, including:

[0060] S1 acquires and processes natural language sentence pairs that require language reasoning;

[0061] s2 uses a pre-trained algorithm model to predict the relationship between the processed sentence pairs;

[0062] Wherein, the algorithm model introduces an intra-sentence attention module and an inter-sentence attention module in the natural language reasoning model; the sentence pair mentioned in the present invention includes a "premise" sentence and a "hypothetical" sentence; the relationship of the sentence pair includes: Contradiction, implication, irrelevance;

[0063] For the training of the algorithm model in step S2, follow the steps below, specifically as figure 2 Shown:

[0064] Step 1. Select existing natural language sentence pairs and preprocess the data;

[0065] Specifically, natural language sentence pairs are selected from the natural langu...

Embodiment 2

[0105] In order to realize the above method, the present invention also provides a natural language reasoning system, such as Figure 5 shown, including:

[0106] Select the candidate sentence pair module to obtain and process the natural language sentence pairs that require language reasoning;

[0107] Loading a reasoning module, using a pre-trained algorithm model, to perform relationship prediction on the processed sentence pairs;

[0108] Wherein, the algorithm model introduces an intra-sentence attention module and an inter-sentence attention module into the natural language reasoning model; the relationship between sentence pairs includes: contradiction, implication, and irrelevance.

[0109] The loading reasoning module includes: model calculation module and model construction and training module;

[0110] Among them, the model calculation module is used to calculate the relationship prediction by using the model trained in the model construction and training module b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a natural language reasoning method and system, and the method comprises the steps: obtaining a natural language sentence pair needing language reasoning, and carrying out the processing; adopting a pre-trained algorithm model to perform relationship prediction on the processed sentence pair; wherein the algorithm model introduces an intra-sentence attention module and an inter-sentence attention module into a natural language inference model; wherein the relationship of the sentence pairs comprises contradiction, implication and independence. According to the method, the interpretability of the result is improved while the performance of the natural language reasoning model is enhanced; according to the algorithm model, an intra-sentence attention module is introduced into a natural language inference model to improve the expression ability of sentences, an inter-sentence attention module is adopted to promote interaction between the sentences, meanwhile, the performance of the natural language inference model is enhanced, and the interpretability of a result is improved.

Description

technical field [0001] The present invention relates to the field of artificial intelligence, in particular to a method for processing natural language using artificial intelligence, in particular to a natural language reasoning method and system. Background technique [0002] Natural language processing aims to explore and implement various theories and methods for effective communication between humans and computers using natural language, and is the core direction of artificial intelligence. Natural language processing has a wealth of application scenarios, of which natural language reasoning is one of the important research contents, the purpose is to judge the relationship between two sentences of "premise" and "hypothesis", which is widely used in question answering, sentiment analysis, dialogue system, etc. [0003] At present, in natural language inference tasks, the attention mechanism is an important part of the model. The attention mechanism can be divided into ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/211G06F40/284G06N5/04G06N3/04
CPCG06F40/211G06F40/284G06N5/04G06N3/045G06N3/044
Inventor 许光銮孙显苏武运于泓峰李沛光姚方龙刘那与王铁平田雨
Owner AEROSPACE INFORMATION RES INST CAS