Hierarchical Storage File Migration Based on Access Frequency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional file migration schemes in hierarchical storage systems are arbitrary, leading to unnecessary file migrations and performance degradation, as they fail to consider factors like file size, access frequency, and user demand, resulting in inefficient resource utilization and increased costs.
Innovation Solution
A method and device for optimizing file migration in hierarchical storage systems by determining the necessity of file migration based on attributes such as size, access frequency, and type, using a predetermined threshold to migrate files from a lower level to a higher level, thereby improving access speed and reducing workloads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If files are migrated based on arbitrary conventional schemes, then file access speed may be improved, but unnecessary file migrations occur and system performance degrades
Solution Approach 1:
The patent changes the parameters used for migration decisions from arbitrary conventions to specific measurable attributes including file access frequency, file size, and file type. By establishing a necessity score based on these parameters and comparing against thresholds, the system achieves more accurate migration decisions that improve access speed without causing performance degradation from unnecessary migrations
Solution Approach 2:
The system implements feedback mechanisms by continuously monitoring file access patterns and updating migration decisions accordingly. Access information including read/write frequencies and time intervals is fed back into the migration necessity calculation, allowing the system to adapt and optimize file placement based on actual usage patterns rather than static rules
2Speed
If files are migrated to higher level storage to improve hit rate, then access speed increases, but costs of the hierarchical storage system increase
Solution Approach 1:
The patent introduces a cost-aware migration framework that uses parameters such as file size, access frequency, and file type to calculate migration necessity. By setting thresholds and using scoring mechanisms, the system ensures files are migrated to higher-level (more expensive) storage only when the access patterns justify the cost, thereby improving access speed for important files while controlling overall storage costs
Solution Approach 2:
The system applies different migration strategies to different files based on their specific attributes. Rather than applying uniform migration rules, the patent evaluates each file's access frequency, size, and type to determine individual migration necessity, ensuring that only files with high access requirements are placed in expensive high-level storage while less critical files remain in lower-level storage
3Speed
If arbitrary file migration is performed, then some files may be accessed faster, but resource utilization becomes inefficient
Solution Approach 1:
The patent changes from arbitrary migration to parameter-driven migration by considering file size, access frequency, file type, and time intervals. The migration necessity score is calculated based on these parameters, ensuring that migration resources are allocated efficiently to files that will actually benefit from faster access, thereby improving overall resource utilization
Data Source
AI summary
Embodiments of the present disclosure provide a storage management method and device. The method comprises: obtaining an attribute and access information of a file stored in storage at a first level in a hierarchical storage system, the attribute of the file indicating a size of the file, and the access information indicating an access frequency of the file; determining necessity of migrating the file based on the attribute of the file and the access information; and in response to the necessity exceeding a predetermined threshold, migrating the file to storage at a second level in the hierarchical storage system, the second level being different from the first level. Embodiments of the present disclosure further disclose a corresponding device.