Cloud Database Hot-Cold Data Placement for Lower Storage Cost
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High storage costs and resource wastage in database systems due to the use of high-performance storage for frequently accessed hot data and redundant standby nodes, which are often idle.
Innovation Solution
Implement a cloud database system with a primary node that locally caches hot data and migrates cold data to cloud storage, using metadata caching to maintain access performance while reducing costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If high-performance storage is used to meet write performance requirements, then write performance is improved, but storage costs increase
Solution Approach 1:
The patent segments data into hot data (frequently accessed) and cold data (infrequently accessed), storing them in different locations. Hot data remains in high-performance local storage while cold data is migrated to cost-effective cloud storage, resolving the contradiction between performance and cost
Solution Approach 2:
The system dynamically migrates data between local storage and cloud storage based on access patterns. Data accessibility thresholds are monitored, and migrations occur automatically when thresholds are crossed, allowing the system to adapt storage allocation to actual performance needs
2Reliability
If multiple standby nodes are deployed to ensure high availability, then reliability is improved, but storage costs and computing resource waste increase
Solution Approach 1:
The patent extracts cold data from standby nodes and migrates it to cloud storage. Only hot data remains on standby nodes for quick access, reducing the storage footprint on redundant nodes while maintaining availability through metadata pointers to cloud-stored cold data
Solution Approach 2:
Instead of storing full copies of all data on multiple standby nodes, the system creates metadata copies that point to cloud-stored data. This allows standby nodes to maintain availability functionality without duplicating expensive cold data storage
3Speed
If cold data is stored on local storage to ensure fast access, then access speed is improved, but storage costs increase
Solution Approach 1:
The patent applies different storage qualities to different data. Local high-performance storage is allocated exclusively to hot data with high access patterns, while cold data with lower access patterns is stored in cloud storage, optimizing both performance and cost
Data Source
AI summary
A data storage method and apparatus, and a computing device are provided. The method includes: in a process in which the first node processes a plurality of access requests, locally storing or caching hot data in the first node, migrating cold data to a cloud storage service, and locally storing or caching metadata of the cold data in the first node, where the cloud storage service is a service deployed by a cloud computing platform in a cloud computing resource, the cloud computing platform deploys a cloud database system in the cloud computing resource managed by the cloud computing platform, the first node is a primary database node or a secondary database node of the cloud database system, the hot data and the cold data are different data tables of the database or different table partitions of the data table.