Folder Scoring for Fast, Low-Cost File System Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data migration methods often result in high costs and low speed due to migrating entire file systems, which is inefficient and resource-intensive during emergencies like storage space shortages or high IO loads.
Innovation Solution
Selecting and migrating optimal folders based on scoring and sorting, rather than entire file systems, to reduce migration costs and increase speed by using an analysis agent to determine migration conditions and a space manager to assess storage systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If entire file systems are migrated during emergencies, then data protection and business continuity are ensured, but migration costs increase and migration speed decreases
Solution Approach 1:
The patent divides the file system into multiple folders and selectively migrates only the necessary folders rather than the entire file system. The migration system identifies and selects specific folders based on migration conditions, thereby reducing migration time and resource consumption while still ensuring data protection and business continuity for the critical data portions.
Solution Approach 2:
The patent extracts and migrates only the essential folders from the file system during emergency situations. By identifying and separating the critical data folders from the rest of the file system, the system achieves fast migration of necessary data while leaving non-critical folders behind, thus resolving the contradiction between complete data protection and rapid migration.
2Reliability
If entire file systems are migrated during emergencies, then data protection and business continuity are ensured, but migration costs increase
Solution Approach 1:
The patent segments the file system into migratable folders and non-migratable portions, allowing selective migration of only the necessary data. This segmentation enables business continuity to be maintained for critical operations while significantly reducing the computational resources, bandwidth, and time costs associated with migrating the entire file system.
Solution Approach 2:
The patent applies partial action by migrating only the essential folders required for business continuity rather than performing a complete file system migration. This partial migration approach suffices to maintain operational reliability while avoiding the excessive costs of transferring unnecessary data.
3Productivity
If selective folder migration is implemented, then migration cost and time are reduced, but system complexity increases
Solution Approach 1:
The patent implements a feedback mechanism where the migration system continuously monitors storage system conditions, folder importance, and migration progress. Based on this feedback, the system dynamically adjusts which folders to migrate and optimizes the migration process, managing the increased complexity through intelligent control while maintaining high migration speed and selectivity.
Solution Approach 2:
The patent changes the parameter of migration scope from 'entire file system' to 'selected folders' based on dynamic assessment of data importance and migration conditions. By adjusting this parameter selectively, the system achieves improved productivity without permanently increasing structural complexity, as the complexity management is handled through parameter-based decision-making rather than structural changes.
Data Source
AI summary
The subject technology generally relates to migration of data. An example method includes determining, in response to determining that a source storage system satisfies a migration condition and based on used space of folders in a source file system on the source storage system, migration scores for the folders. The method further includes determining, from the folders, one or more folders to be migrated by sorting the migration scores. In addition, the method further includes migrating the one or more folders to a target file system. As a result of such data migration, by scoring and sorting a group of folders on a source file system and selecting the optimal one or more folders for migration, the migration of the entire file system is avoided, thereby reducing the overall cost of data migration and increasing the speed of data migration.