Sequence data prediction system of novel multi-scale attention mechanism

A sequential data and multi-scale technology, applied in the direction of electrical digital data processing, special data processing applications, biological neural network models, etc., can solve the problems of low accuracy and high time cost, reduce space overhead, improve trends and values Accuracy, the effect of reducing time overhead

Inactive Publication Date: 2019-11-12
BEIHANG UNIV
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, various RNN-based models, which are the basic methods of sequence prediction in deep le

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sequence data prediction system of novel multi-scale attention mechanism
  • Sequence data prediction system of novel multi-scale attention mechanism
  • Sequence data prediction system of novel multi-scale attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. In this embodiment, the Transformer structure is used as the basis, the encoding module of the Transformer is combined with the multi-scale temporal feature extraction module in the present invention, the decoding module of the Transformer is combined with the long-sequence fast prediction module in the present invention, and the present invention is used The sequence data encoding module in the invention encodes input data to obtain a representation of a sequence data prediction system based on a multi-scale temporal attention mechanism. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various em...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sequence data prediction system of a novel multi-scale attention mechanism. The sequence data prediction system comprises a sequence data coding module combined with time feature coding, a multi-scale time feature extraction module and a long sequence rapid prediction module; the sequence data coding module combined with time characteristic coding codes sequence data andtime characteristics of an input sequence to obtain a new input vector; the multi-scale time feature extraction module is used for segmenting the new input vector, inputting the segmented new input vector into a corresponding feature extraction structure, and combining the extracted sequence features of different time scales to obtain stable and effective time sequence representation; and the long-sequence rapid prediction module constructs an initial input sequence, performs data encoding and then performs fusion to obtain a prediction output result.

Description

technical field [0001] The invention relates to a sequence data prediction system, in particular to a sequence data prediction system with a novel multi-scale attention mechanism. Background technique [0002] Sequence data refers to a collection of observations collected in a certain order. Taking time series as an example, it is a set of data arranged in time order. Sequence data widely exists in all aspects of social life and industrial production, such as medical diagnosis, meteorological research, power system, intelligent transportation, etc. The prediction of sequence data is a typical data science task, and accurate and effective prediction results are of great significance to the decision-making of data application scenarios. [0003] Sequence data often contains time dependence, that is, the generation of data in the sequence is closely related to change and time. Time series has the characteristics of seasonality, cycle, trend and randomness, etc. Accurate predi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/22G06N3/02
CPCG06N3/02
Inventor 李建欣周号益仉尚航彭杰奇张帅
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap