Data classification storage method, device and system

Abstract

The invention discloses data classification storage method, device and system, wherein the method comprises the steps: acquiring the use frequency of a data table from an ETL (Extraction Transformation Loading) schedule table, and acquiring the appearance frequency of the data table from a buffer pool; according to the usage frequency and appearance frequency of the data table, calculating the heat of the data table; and according to the level of the data table, performing classification storage on the data table. The heat of the data table is calculated according to the usage frequency of the data table, acquired from the ETL schedule table, and the occurrence frequency in the buffer pool, so that the evaluation on the data table is more accurate, the classification storage is more precise to meet the practical condition of the data table, and the system performance can be improved. Different from the traditional method of carrying out data partitioning according to time slices, data in the same one data table can be stored by means of multiple types, the data table can be used for storing data on various performances according to the condition of heat difference, the workload of shifting a great deal of data in each day can be reduced, and the usage rate of the system performance can be promoted.

Description

Technical field [0001] The present invention relates to a business support technology, in particular to a data hierarchical storage method, device and system. Background technique [0002] Hierarchical storage is a commonly used strategy for efficient storage utilization in today’s data warehouse projects. Its main intention is to take into account the energy consumption input and output consumption ratio without reducing efficiency. It is the most cost-effective storage strategy . Hierarchical storage is based on a high-efficiency and low-cost idea, and the pursuit of the highest cost-effective input and output. In the business analysis system, the advantages of introducing hierarchical storage technology are: [0003] 1. Reduce overall storage costs: Infrequently accessed data resides in lower-cost storage devices, which can comprehensively give play to the performance advantages of high-performance storage devices and the cost advantages of low-priced storage devices; [0004] ...

AI Technical Summary

Problems solved by technology

[0014] (1) Sacrificing hardware efficiency and bringing data redundancy;

[0015] (2) Increase the complexity of the system, bring huge data migration, and waste the entire system;

[0016] (3) Decisions are made entirely based on business experience and subjective judgment, and there is also a lack of objective calculation basis for the results of hierarchical storage implementation

Images