Relation enhanced sentence sorting method based on Bert model

A sorting method and enhanced technology, applied in biological neural network models, instruments, electrical digital data processing, etc., can solve the problems of lack of relative order prediction methods, models that are not particularly stable and effective, and insufficient attention to local information of texts, etc.

Pending Publication Date: 2021-02-02
ZHEJIANG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the disadvantage of these works is that they do not pay enough attention to the local information of the text, and use the relative order information to enhance the entire network at the same time, including the encoder and decoder.
In addition, the current work lacks a better relative order prediction method. They calculate the relative information of sentences based on the sentence vectors of two sentences, and do not directly conn...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Relation enhanced sentence sorting method based on Bert model
  • Relation enhanced sentence sorting method based on Bert model
  • Relation enhanced sentence sorting method based on Bert model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0063] On the contrary, the present invention covers any alternatives, modifications, equivalent methods and schemes within the spirit and scope of the present invention as defined by the claims. Further, in order to make the public have a better understanding of the present invention, some specific details are described in detail in the detailed description of the present invention below. The present invention can be fully understood by those skilled in the art without the description of these detailed parts.

[0064] refer to figure 1, shown is the flow chart of the relationship-enhanced sentence ordering method based on Bert model of the embodiment of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a relation-enhanced sentence sorting method based on a Bert model, which utilizes the Bert model to mine semantic and logical relations among sentences and performs more comprehensive modeling on the coherence of texts. According to the invention, the method comprises the steps: establishing a relation enhancement type pointer network decoder, and efficiently integrating the reliable relative sequence information into a pointer network through a relation enhancement module; enabling the relation enhancement module to accurately capture the relative sequence of sentencepairs and construct high-level semantic representation of the sentence pairs based on a Bert model, so as to help a pointer network to mine the global relation between unordered sentences and fully consider the local dependence between current candidate sentences and sentences of which the sequence is already arranged; therefore, the network can obtain local and global coherence of the text at thesame time, and a smoother and more reasonable sentence sequence is generated. Compared with a previous sorting method, the technology provided by the invention has the advantages that the sentence sorting accuracy is remarkably improved, and the practical value is relatively good.

Description

technical field [0001] The invention belongs to the technical field of natural language processing, and relates to a relationship-enhanced sentence sorting method based on a Bert model. Background technique [0002] Modeling the coherence of text is one of the key problems in natural language processing. A well-organized and logical text is easier for people to read and understand; on the contrary, incorrect sentence order will lead to ambiguity in the content of the text and reduce readability. The sentence sorting task plays a very important role in enhancing the coherence of the text. This task is to reorder some sentences whose order is disordered or unknown by analyzing the semantic relationship and logical information between the sentences, so that they can form a smooth and coherent structure. of the text. Sentence sorting tasks have a wide range of applications in the field of natural language processing, such as automatic summarization of multiple documents, compo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/216G06F40/30G06F40/126G06N3/04
CPCG06F40/216G06F40/30G06F40/126G06N3/049G06N3/047G06N3/045
Inventor 崔白云李英明张仲非
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products