Time sequence prediction method based on differential fusion Transform

A timing prediction and differential fusion technology, applied in neural learning methods, biological neural network models, design optimization/simulation, etc., can solve problems such as poor generalization, insufficient time-dependent learning, and weak control ability , to achieve the effect of improving deep learning ability, avoiding gradient explosion and disappearance problems, enhancing deep training ability and generalization ability

Pending Publication Date: 2022-08-02
SOUTHWEST JIAOTONG UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] To sum up, the existing time series data prediction methods still have shortcomings such as weak ability to control the overall situation, insufficient learning of time dependence, and poor generalization.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Time sequence prediction method based on differential fusion Transform
  • Time sequence prediction method based on differential fusion Transform
  • Time sequence prediction method based on differential fusion Transform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are a part of the embodiments of the invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0060] A time series prediction method based on differential fusion Transformer of the present invention comprises the following steps:

[0061] Step S1, preprocessing the time series data;

[0062] Perform outlier processing and missing value imputation on the collected data to construct a multivariate sequence dataset Among them, L is the total length of the time series, and d is the total number of variables participating in the model; this dataset takes the future time series value of one of the variables a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a time sequence prediction method based on differential fusion Transform, and the method comprises the steps: designing a differential layer, a neighbor attention mechanism, a sliding fusion mechanism and a residual layer on the basis of a classical Transform architecture through employing an encoder and decoder structure; specifically, feature differences of adjacent time points of time series data are extracted and focused through a difference layering and neighbor attention mechanism, various nonlinear features of each time point are fused through a sliding fusion mechanism, multi-granularity key features in a multivariable time series can be effectively extracted, and a core component further comprises a one-dimensional convolution and LSTM fusion residual layer. Therefore, the mutual dependency relationship between time points of the time series data is further learned, and the deep feature learning capability of the model on the complex multivariable time series data is improved. Compared with an existing method, the method has the advantages of being good in stability, high in prediction precision, high in generalization ability and the like.

Description

technical field [0001] The invention relates to a time sequence prediction method based on differential fusion Transformer, and belongs to the technical field of time sequence prediction. Background technique [0002] In recent years, with the rapid application of the Internet of Things and the rapid development of big data and artificial intelligence, the operation and maintenance of smart city traffic is moving towards an autonomous, large-scale and intelligent direction. With the explosive growth of urban spatiotemporal data, traditional management methods can no longer meet the business needs of the digital age. Therefore, it is urgent to develop more autonomous and efficient technical solutions to optimize traffic resources and improve the availability and stability of resources. It is necessary to continuously measure and monitor various time series data. Through the prediction of various time series variables, time series trends can be found in time, early warning and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F30/27G06N3/04G06N3/08
CPCG06F30/27G06N3/08G06N3/048G06N3/044G06N3/045Y04S10/50
Inventor 杜圣东李本涵李天瑞方勇胡节苏敏唐楷
Owner SOUTHWEST JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products