A method and system for storing time series data based on time domain and frequency domain
A technology of time series data and data, applied in the field of data processing, can solve the problems of large memory occupation, large loss of precision, inability to adapt to time series scenarios, user needs, etc.
Active Publication Date: 2018-12-28
TSINGHUA UNIV
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The present invention provides a time-series data storage method and system based on the time domain and frequency domain, which overcomes the above problems or at least partially solves the above-mentioned problems. And it cannot adapt to different time series scenarios and user needs
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0036] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.
[0037] The basic unit of time-series data is a measurement unit, denoted by m. The format of m is m=(t, v), indicating that the measured value at time t is v. A period of time series data S consists of n measurement units incremented by t, denoted as S(m 1 , m 2 ,...,m n ), where the time column is recorded as St=(t 1 , t 2 ,...,t n ), the value column is recorded as Sv=(v 1 , v 2 ,...,v n ). |S| indicates the number of data points contained in S, and Sv(c) indicates the cth measurement unit m in S c The measured value of v c . The error rate of the value column S2v of time series S2 relative to the value column S2v of another time series S1 is:
[0038]
...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a time domain and frequency domain based time series data storage method and system. The time domain and frequency domain based time series data storage method comprises the steps of dividing to-be-stored time series data into multiple sections of time series data, and extracting frequency domain information of a value column in each section of the time series data in sequence; calculating an error rate of the frequency domain information and comparing the error rate with a set tolerable error rate; if the error rate of the frequency domain information is less than the tolerable error rate, enabling the time domain information to be stored in the time column of the section of the time series data and enabling the frequency domain information to be stored in the valuecolumn thereof; and if the error rate of the frequency domain information is greater than the tolerable error rate, enabling the frequency domain information to be stored in the time column of the section of the time series data and enabling the time domain information to be stored in the value column thereof. By utilizing the characteristics of the frequency domain of the time series, the valuecolumns of time series are subjected to frequency domain and time domain hybrid storage according to requirements; the time domain and frequency domain based time series data storage method and systemcan adapt to different time sequence scenes and different user demands; the storage space is reduced greatly; and as users can set parameters, balance between magnetic disk occupation and the error rate can be realized.
Description
technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to a method and system for storing time series data based on time domain and frequency domain. Background technique [0002] The industrial field usually needs to process time-series data. Time-series data refers to time-series data. Time-series data is a data column recorded in chronological order by the same unified index, that is, the data types in a period of time series are the same. Each data point in time series data contains a timestamp and an observation value, such as data generated by monitoring CPU utilization, memory usage, etc. in a computer, all belong to time series. Time series data is often used in scenarios such as analysis, fault diagnosis, forecasting, etc. [0003] As more and more sensors are deployed, the amount of time series data is gradually increasing, and the traditional relational database can no longer meet the storage require...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/14G06F17/30
CPCG06F16/221G06F16/2474G06F17/141
Inventor 王建民黄向东乔嘉林王晨龙明盛
Owner TSINGHUA UNIV