Time series prediction system and method based on PT-LSTM

A technology for time series and forecasting systems, applied in forecasting, neural learning methods, biological neural network models, etc., and can solve problems such as inconsistency, inability to directly input, and too long time series data.

Pending Publication Date: 2021-03-30
BEIHANG UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the length of the actual time series data is often too long to be directly input into the RNN, and the time series needs to be divided into multiple subsequences through a sliding window
However, different times have different impacts on the sequence values, which makes the sequence values ​​in different windows vary greatly, which may cause the actual content learned by the model to be inconsistent with the expected content

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Time series prediction system and method based on PT-LSTM
  • Time series prediction system and method based on PT-LSTM
  • Time series prediction system and method based on PT-LSTM

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0061] First, the whole process of the method of the present invention is described.

[0062] figure 1 The basic frame diagram of the example of the present invention is shown, which consists of three parts: sequence preprocessing, position encoding and model training. The function of the sequence preprocessing part is to divide the time series data into three types of subsequences according to the prediction task. The position coding part is mainly to obtain the vector representation of the past moment through position coding. The model training part is mainly to train PT-LSTM. After the model is trained, it can be directly predicted, and the denormalized result output by PT-LSTM during prediction is the predicted value. The system of the present invention is as follows: comprising: time series data representation module, model design module and pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a time series prediction system and method based on PT-LSTM and the method specifically comprises the steps: obtaining the representation of time sequence data based on positioncoding, so as to not only enable time information to be added to input data explicitly, but also weaken the interference of a sliding window in an original data partitioning process; the invention provides a method capable of utilizing time sequence characteristics, namely a position coding and time gate expansion LSTM (Position Encoding and Time Gateway LSTM), and the method is abbreviated as PT-LSTM. The method is innovative in two aspects, one aspect is input data representation, the time series data representation provided by the invention is used as input, the other aspect is model structure optimization, a new network structure, namely T-LSTM, is designed, a specially designed time gate is added in the T-LSTM, the time gate is mainly controlled by time attributes, and the model structure is optimized. Partial control effects are achieved in the input data acquisition stage, the internal state updating stage and the result output stage of the model; a prediction framework based on PTLSTM is designed.

Description

technical field [0001] The present invention relates to the fields of time series forecasting and deep learning, and relates to a PT-LSTM-based time series forecasting system and method, which are used to solve the problem that the recurrent neural network cannot utilize time series characteristics. Background technique [0002] Time series prediction has important applications in many fields. In recent years, with the popularity of deep learning, many people have begun to introduce recurrent neural network (RNN) into time series prediction problems, and have made great achievements in their respective fields. good result. Compared with the differential integrated moving average autoregressive model (ARIMA), RNN has a strong nonlinear fitting ability, can capture the correlation between sequences well, and is suitable for various types of time series. Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) are two common RNN structures. According to the different proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/04G06N3/04G06N3/08
CPCG06Q10/04G06N3/049G06N3/08G06N3/048G06N3/045
Inventor 于勇强郎波刘宏宇夏欣怡
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products