Access-Frequency-Based Data Migration With Staged Replication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data migration technologies face inefficiencies and increased failure risks due to inaccurate division of cold and hot data, leading to excessive workload in incremental replication stages and network bandwidth demands, particularly when movers and synchronizers conflict.

Innovation Solution

Determine access patterns and frequencies for data objects based on historical access data to prioritize full replication of low-access-frequency data, reducing the workload in incremental replication stages and improving migration efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If full replication is performed on all data objects without differentiation, then data completeness is ensured, but network bandwidth consumption and migration time increase significantly

Engineering Contradiction:
Improvedata completenessVSAvoidmigration time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments data objects into different categories (hot data, warm data, cold data) based on access patterns and frequencies. This segmentation allows differential replication strategies to be applied: hot data receives full replication with high priority, warm data receives selective replication, and cold data receives minimal or no replication. This resolves the contradiction by maintaining data completeness for critical data while reducing overall migration time through selective optimization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different replication priorities and strategies to different data objects based on their specific access characteristics. Instead of uniform treatment, each data object receives customized replication parameters (priority levels, replication factors, timing) matched to its access pattern. This ensures that data completeness is maintained where needed while minimizing migration time for less critical data.

Inventive Principle:
Principle #3Local quality

2Reliability

If incremental replication is performed on all data objects, then data synchronization is maintained, but workload and system resource consumption increase

Engineering Contradiction:
Improvedata synchronizationVSAvoidsystem efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments data objects into different categories based on access patterns, applying differential incremental replication strategies. Hot data objects receive continuous incremental replication to maintain strict synchronization, while warm and cold data objects receive reduced or deferred incremental replication. This segmentation maintains data synchronization for critical data while reducing overall system workload and improving efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by performing incremental replication selectively on only those data objects that require it (primarily hot data), rather than on all data objects. This partial replication approach maintains sufficient data synchronization for operational data while significantly reducing system workload and resource consumption compared to universal incremental replication.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If data objects with high access frequency are replicated first, then data availability is improved, but migration time for complete data set increases

Engineering Contradiction:
Improvedata availabilityVSAvoidtotal migration time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent segments the migration process into phases based on data categories. In the first phase, hot data objects (high access frequency) are replicated with high priority to quickly improve data availability. In subsequent phases, warm and cold data objects are replicated with lower priority. This segmented approach achieves rapid availability improvement for critical data while completing the full data set migration within acceptable total time through parallel and prioritized processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary identification and prioritization of high-access-frequency data objects before the migration begins. By pre-analyzing access patterns and marking critical data objects, the system can immediately prioritize their replication at the outset, ensuring rapid data availability improvement without delaying the overall migration schedule for less critical data.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If access pattern analysis is performed on all data objects, then replication accuracy is improved, but processing overhead and time consumption increase

Engineering Contradiction:
Improveaccess frequency prediction accuracyVSAvoidprocessing overhead
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the data object population into different analysis groups based on initial characteristics or sampling results. Instead of performing comprehensive access pattern analysis on all data objects, the system focuses detailed analysis on segments most likely to contain hot data (e.g., frequently accessed directories, recently modified files). This segmented analysis approach maintains high prediction accuracy for critical data while reducing overall processing overhead by applying lighter analysis to less critical segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements self-service mechanisms where the system learns access patterns from actual runtime behavior and automatically adjusts replication priorities without requiring exhaustive pre-analysis. By monitoring access patterns during operation and dynamically adapting replication strategies, the system achieves high prediction accuracy through continuous learning rather than through computationally expensive upfront analysis of all data objects.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250321939A1Method, device, and computer program product for data migration
Publication Date: 2025.10.16 DELL PROD LP
  • US20250321939A1 patent drawing
  • US20250321939A1 patent drawing
  • US20250321939A1 patent drawing

AI summary

An example data migration includes, based on historical access data for objects, determining access patterns for the objects, and, based on the access patterns, determining access frequencies for the objects in a full replication stage. Based on the access frequencies for the objects, full replication is carried out on the objects, and, in response to completion of the full replication of the objects, incremental replication is carried out on at least part of the objects to complete data migration. In this way, the access frequencies for the objects can be predicted more accurately, then the objects with low access frequencies are preferentially replicated in the full replication stage, and the workload of incremental replication is reduced, thereby improving the efficiency and quality of data migration, reducing the probability of migration failure, avoiding unnecessary data transmission, and effectively reducing the demands for network bandwidth and data storage.