Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Hot and cold data-oriented hierarchical storage system and method

A cold and hot data, hierarchical storage technology, applied in the input/output process of data processing, database indexing, structured data retrieval, etc., can solve the problem of inability to adapt to changes in data access patterns, reduce storage space overhead, and optimize storage. Structure, the effect of efficient reading

Active Publication Date: 2021-06-11
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF13 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, for the problem that data storage cannot adapt to the change of data access mode, the present invention dynamically adjusts the storage threshold of the database according to the data temperature distribution in the hot database, and migrates the data exceeding the threshold to the cold database to complete the separate storage of hot and cold data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hot and cold data-oriented hierarchical storage system and method
  • Hot and cold data-oriented hierarchical storage system and method
  • Hot and cold data-oriented hierarchical storage system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, the specific implementation manners of the present invention will now be described with reference to the accompanying drawings.

[0033] In this example, if figure 1 As shown, a hierarchical storage system for hot and cold data includes a data acquisition module, a hot and cold data judgment module, and a hot and cold data migration module. Among them, the data acquisition module is used to collect user input data; the hot and cold data determination module is used to calculate the temperature of the data according to the temperature calculation related information, and update and repackage the temperature calculation related information and the calculated temperature information into the original data ;The hot and cold data migration module is used to monitor the data in the hot storage, migrate the hot data that does not meet the two set thresholds in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a hot and cold data-oriented hierarchical storage system and method. The system comprises a data acquisition module, a hot and cold data judgment module and a hot and cold data migration module; the data acquisition module is used for acquiring a user data access request; the cold and hot data judgment module is used for analyzing the data access request, calculating the data temperature according to the analyzed temperature calculation related information, updating the temperature calculation related information and the data temperature, and re-packaging the temperature calculation related information and the data temperature to original data; and the cold and hot data migration module is used for monitoring the data in a hot library, migrating the hot data which does not conform to two set thresholds in the hot library into the cold storage, and dynamically adjusting the set thresholds according to the data access characteristics. According to the method, the temperature of the data is quantified on the basis of the characteristics of the data in three aspects of access time, access frequency and data relevance, and judgment of cold and hot data and separated storage of the cold and hot data are realized.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a hierarchical storage system and method for hot and cold data. Background technique [0002] The storage demand brought about by the surge in data volume continues to increase, and enterprises optimize storage space by establishing a hierarchical storage architecture. In order to improve the space utilization in the tiered storage system, the enterprise divides the data into hot data with frequent access and cold data with infrequent access, and matches the data access characteristics with the performance of storage devices to avoid cold data residing in high Storage pollution caused by the performance storage layer. The identification accuracy of hot and cold data will directly affect the data access efficiency of the hierarchical storage system. [0003] Therefore, it is of great significance to carry out research on the storage mechanism for hot and cold data. The res...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22G06F16/21G06F3/06
CPCG06F16/2291G06F16/214G06F3/0608G06F3/0619Y02D10/00
Inventor 范淑焕侯孟书许佳欣李玉军周世杰
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products