NIC-Managed Data Migration for Transparent Storage Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data migration processes in computing devices often impede access to stored data during migration, requiring software agents or configuration changes on compute resources, which can compromise system security and stability.
Innovation Solution
A Network Interface Controller (NIC) manages data migration by mirroring writes to both source and destination, selectively reading from either based on workload, and maintaining synchronization data to ensure seamless migration transparent to compute resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data migration is performed using existing processes, then data can be migrated from source to destination, but access to stored data is impeded during migration
Solution Approach 1:
The patent segments the data migration process into distinct phases handled by different components: the NIC handles transparent data interception and forwarding, while the migration controller manages the overall migration workflow. This segmentation allows data access to continue through the NIC while migration progresses in the background, resolving the contradiction between maintaining access continuity and achieving migration efficiency.
Solution Approach 2:
The patent introduces an intermediary NIC (Network Interface Controller) that acts as a mediator between the compute resources and the storage system. The NIC intercepts data writes and selectively forwards them to the migration controller, enabling seamless data migration without impacting compute resources or data access continuity. This intermediary component resolves the contradiction by decoupling the migration process from the data access path.
2Reliability
If software agents are deployed on compute resources for migration, then migration can be managed, but system security is compromised
Solution Approach 1:
The patent extracts the migration management functionality from the compute resources and places it in a dedicated migration controller. By taking out the software agent requirement from compute resources, the system maintains security while still enabling migration management through the NIC and migration controller combination. This extraction resolves the contradiction between system security and migration management ease.
Solution Approach 2:
The NIC performs self-service by automatically intercepting data writes and selectively forwarding them to the migration controller without requiring software agents on compute resources. This self-service capability enables migration management while maintaining system security, as the NIC operates independently of the compute resource software stack.
3Reliability
If configuration changes are made on compute resources for migration, then migration can be performed, but system stability is compromised
Solution Approach 1:
The NIC serves as an intermediary that enables migration capability without requiring configuration changes on compute resources. It transparently intercepts data writes and forwards them to the migration controller, providing migration adaptability while maintaining system stability by leaving compute resource configurations unchanged.
Solution Approach 2:
The patent replaces the mechanical approach of modifying compute resource configurations with a software-based interception and forwarding mechanism in the NIC. This substitution enables migration capability while maintaining system stability, as the NIC operates at the network interface level without affecting the compute resource configuration.
Data Source
AI summary
Methods and systems for managing storage of data in a distributed system are disclosed. To manage storage of data in a distributed system, a data processing system may include a network interface controller (NIC). The network interface controller may present emulated storages that may be used for data storage. The emulated storage devices may utilize storage resources of storage devices. Overtime, the data stored in various data storages may be migrated between the data storages. To migrate the data, the NIC may manage the migration process. To do so, the NIC may obtain various access requests (e.g., writes, reads) and process them in a manner that allows for the migration to be transparent. By doing so, migrations that are transparent to compute resources of data processing systems may be completed.