Hierarchical Storage File Migration by Size Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hierarchical storage systems face performance degradation due to the need to interrupt migration operations to service immediate recall requests, which can be time-consuming and disrupt data access responsiveness.
Innovation Solution
The system partitions secondary storage devices into small-file and large-file devices, allowing for efficient migration of files based on size, thereby minimizing the time required for migration and reducing wait times for recall operations by dedicating specific drives for each type of file.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If files are migrated to secondary storage devices without size-based partitioning, then storage capacity is utilized, but recall operation wait time increases due to migration interruptions
Solution Approach 1:
The patent segments the secondary storage pool into multiple storage pools based on file size characteristics. Small files are routed to storage pools optimized for small-file operations, while large files are routed to storage pools optimized for large-file operations. This segmentation prevents small recall operations from being blocked by large migration operations, thereby reducing recall wait time while maintaining overall migration efficiency through specialized handling paths.
2Speed
If recall operations are performed immediately without migration completion, then data access responsiveness is improved, but data integrity may be compromised
Solution Approach 1:
The patent implements preliminary actions by pre-migrating small files to the secondary storage system before they are needed for recall operations. The small-file migration path operates independently and completes migrations in advance, ensuring data is readily available when recall is requested. This preliminary action allows immediate recall without compromising data integrity, as the small files are already staged and ready for retrieval.
3Ease of operation
If a single secondary storage pool is used for all files, then system complexity is minimized, but recall performance degrades due to migration interruptions
Solution Approach 1:
The patent applies local quality by creating storage pools with specialized characteristics tailored to specific file size requirements. Small-file storage pools are configured with parameters optimized for small-file migration and recall patterns, while large-file storage pools are configured for large-file operations. This localized optimization allows recall operations on small files to proceed quickly without being interrupted by large-file migrations, improving recall performance while maintaining manageable system complexity through automated routing rules.
Data Source
AI summary
A method, executed by at least one processor, includes receiving a migration request for a plurality of files, assigning files of the plurality of files that are smaller than a selected size to one or more small-file secondary storage devices, assigning files of the plurality of files that are larger than the selected size to one or more large-file secondary storage devices, and initiating migration of the plurality of files from one or more primary storage devices to the secondary storage devices to which they are assigned. A corresponding computer program product and computer system are also disclosed herein.