Hierarchical Data Storage Using Access-Frequency Cache Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage methods in computing devices face challenges in efficiently managing large-capacity data storage and accessing embedded parameters, leading to increased memory occupation and performance issues due to resource usage exceeding thresholds, resulting in out-of-memory conditions.
Innovation Solution
Implementing a hierarchical data storage system that migrates frequently accessed data to a high-bandwidth storage area and less frequently accessed data to a lower-bandwidth area, using a cache threshold to determine data migration based on access frequency, thereby optimizing storage and access efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored in a single storage area with large capacity, then storage capacity is improved, but data access efficiency deteriorates
Solution Approach 1:
The storage system is divided into multiple storage areas with different bandwidth characteristics. Frequently accessed data is stored in high-bandwidth areas while less frequently accessed data is stored in lower-bandwidth areas, allowing the system to maintain both large storage capacity and high access efficiency for hot data.
Solution Approach 2:
The patent introduces a new dimension of storage hierarchy based on access frequency. By organizing data into multiple storage areas with different bandwidth characteristics and managing data migration between them based on access patterns, the system resolves the contradiction between capacity and speed.
2Speed
If all data is kept in high-bandwidth storage area, then data access efficiency is improved, but memory occupation exceeds threshold
Solution Approach 1:
Different storage areas are assigned different quality characteristics in terms of bandwidth. Only the data that requires high access speed (frequently accessed data) is kept in high-bandwidth storage areas, while other data is stored in lower-bandwidth areas, thus optimizing memory usage while maintaining access efficiency for critical data.
Solution Approach 2:
The system dynamically manages data placement between storage areas based on access frequency. Data can be migrated from high-bandwidth areas to lower-bandwidth areas when access frequency decreases, and vice versa when access frequency increases, allowing the system to adaptively balance memory occupation and access efficiency.
3Speed
If data migration is implemented between storage areas, then data access efficiency is improved, but system complexity increases
Solution Approach 1:
The system uses access frequency as feedback to control data migration decisions. By monitoring how often data is accessed and using this information to determine whether to migrate data between storage areas, the system automates the optimization process and reduces the need for complex manual management while improving access efficiency.
Data Source
AI summary
Implementations of the specification provide a method and system for hierarchical data storage, and relate to a data storage technology. Key points of the method and system for hierarchical data storage include: obtaining a current access frequency of target data based on a request for accessing the target data initiated to a first storage area and a historical access frequency of the target data, where data in the first storage area is moved from a second storage area and has a historical access frequency mark, and the historical access frequency mark reflects a historical quantity of times of requesting to access corresponding data from the first storage area; and in response to that the current access frequency is greater than a cache threshold, keeping the target data in the first storage area or migrating the target data from the second storage area to the first storage area, and updating a historical access frequency mark of the target data based on the current access frequency of the target data, where the first storage area has a larger data transmission bandwidth than the second storage area.