Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for implementing copy mechanism independent of attention mechanism

A technology of attention and mechanism, applied in the computer field

Active Publication Date: 2022-04-29
义语智能科技(广州)有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the traditional copy mechanism, the copy probability distribution of the original text comes from the attention mechanism, which will make the copied words reach more than 95%. In fact, statistics show that this ratio should be only about 60% under normal circumstances, and this is more than 95%. A lot of copies are still wrong, so the traditional copy mechanism urgently needs to be improved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for implementing copy mechanism independent of attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0052] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0053] Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and / or nonvolatile memory such as read only memory (ROM) or flash RAM. Memory is an example of computer readable media.

[0054] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static rando...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The purpose of the present invention is to provide a method and device for realizing a copy mechanism independent of the attention mechanism. The present invention sequentially passes through context coding, filter coding, decoding-preparation for input, decoding-generation output, decoding-copy modulation, decoding- Copy probability map decoding-weighted output, the copy mechanism of the present invention is relatively independent of the attention mechanism, especially its probability distribution is independent of the probability distribution of the attention mechanism, which is conducive to the copy mechanism to exert its effectiveness.

Description

technical field [0001] The invention relates to the field of computers, in particular to a method and device for realizing a copy mechanism independent of an attention mechanism. Background technique [0002] In the traditional copy mechanism, the copy probability distribution of the original text comes from the attention mechanism, which will make the copied words reach more than 95%. In fact, statistics show that this ratio should be only about 60% under normal circumstances, and this is more than 95%. A lot of copies are still wrong, so the traditional copy mechanism needs to be improved urgently. Contents of the invention [0003] An object of the present invention is to provide a method and device for implementing a copy mechanism independent of attention mechanism. [0004] According to one aspect of the present invention, there is provided a method for implementing a copy mechanism independent of attention mechanism, the method comprising: [0005] Encoding the lo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/205G06F40/30G06N3/04
CPCG06F40/205G06F40/30G06N3/048
Inventor 章乐陆晨昱舒畅何永李传丰武拥珍
Owner 义语智能科技(广州)有限公司