Recurrent neural network-based database query time prediction method

A technology of recurrent neural network and query time, applied in the field of deep learning, can solve problems such as lack of reference, difficulty in mapping to time units, and inability to give predictions, etc., to achieve reference, accurate prediction results, and improved query efficiency and query accuracy

Active Publication Date: 2017-12-19
ZHEJIANG UNIV
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

It describes an improved method called predicting how fast queries are going on during real world scenarios like stock market prices overcomes previous methods based only on fixed data points such as price levels. By converting complicated operations into a single dimensionality, this approach improves performance compared to older models. Additionally, there're certain benefits from utilizing LSTM networks instead of traditional ones due to their ability to learn patterns quickly without being trained too hard. Overall, these improvements lead to faster and higher quality results when searching through large databases containing many different types of information.

Problems solved by technology

This patented technology addresses issues with estimating the number of times each SQL operation takes place on disk space (the size of memory needed). Current methods only consider one aspect - wait time prediction, while others use estimated costs instead of actual hardware usage. Additionally, current techniques involve expensive calculations involving multiple tables and complicated algorithms like matrix factorization.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Recurrent neural network-based database query time prediction method
  • Recurrent neural network-based database query time prediction method
  • Recurrent neural network-based database query time prediction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The technical solution of the present invention will be further described in conjunction with specific implementation and examples.

[0029] Such as figure 1 Shown, specific embodiment of the present invention and implementation work process thereof are as follows:

[0030] Step 1: First extract the query plan from the historical query records of the database to form the original data. A query plan contains operation information and running time, such as figure 1 The extraction process shown in .

[0031] Step 2: Classify the original data according to the running time of the query plan, so that the number of query plans in each category is equal, that is, the data set covers short-term queries and long-term queries. After randomly shuffling the data set, it is divided into 80% and 20%. 80% of the data is used as the training set and 20% of the data is used as the test set.

[0032] Step 3: Perform special processing on the query plan to obtain the operation sequenc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a recurrent neural network-based database query time prediction method. The method comprises the following steps of: firstly extracting query plans from database history query records so as to form original data, wherein each query plan comprises operation information and operation time; classifying the original data according to the lengths of the operation time to ensure that the quantities of the query plans in various types are the same; specially processing the query plans to obtain an operation sequence and an operation time sequence; taking the operation sequence as a feature vector, taking the operation time sequence as a label, inputting the feature vector and the label into a neural network, and carrying out training to obtain a model; for a to-be-predicted query plan, repeating the steps to obtain an operation sequence, inputting the operation sequence into the model, and outputting the operation time sequence to complete the prediction of a database query time. The method is capable of obtaining favorable effect in the aspect of relational database query time prediction, and the correctness of the model under simulated data training is higher than 78%. The method can be used for solving the key problems in query optimization and load management.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products