Data Migration via Physical Media Cartridge
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern data centers face significant challenges in data migration due to the large volume of data, which results in lengthy processes consuming substantial network bandwidth. Additionally, maintaining multiple copies of data during migration is costly and prone to interruptions from network conditions.
Innovation Solution
The method involves transferring data from a storage cluster to a migration cartridge, converting the data into an archival format, storing it on a media card, and then physically moving the media card to another data center. There, the data is read from the media card into another migration cartridge and stored in an archival cluster, optimizing the migration process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is migrated through network between data centers, then data transfer can be performed, but network bandwidth is consumed and migration time is extended
Solution Approach 1:
The patent extracts the data transfer process from the network environment and relocates it to a physical media-based system. Data is copied from source storage to portable media (tape, disk, or solid-state drives), physically transported to the destination data center, and then loaded into archival storage. This extraction eliminates dependence on network bandwidth and transfers the bottleneck to physical media I/O and transportation, dramatically reducing network resource consumption while maintaining migration capability.
Solution Approach 2:
The patent introduces portable media (tape libraries, disk arrays, or solid-state drive arrays) as an intermediary between source and destination data centers. This intermediary serves as a buffer that decouples the migration process from network constraints, allowing data to be staged locally and transported physically rather than transmitted continuously over the network, thereby improving migration speed independence from network bandwidth.
2Reliability
If multiple copies of data are maintained during migration, then data availability is ensured, but storage costs increase
Solution Approach 1:
The patent performs data validation and verification during the copying process to source media, ensuring data integrity before physical transport. Checksum verification and error detection are conducted preliminarily, reducing the need for multiple redundant copies at the destination. This preliminary action ensures reliability while minimizing the quantity of stored data needed during migration.
Solution Approach 2:
The patent creates copies of data on portable media for transport rather than maintaining multiple simultaneous copies in networked storage systems. The portable media serves as a temporary copy that is physically moved, replacing the need for multiple active copies in buffer clusters. This approach maintains data availability through the copy process while significantly reducing the storage capacity required compared to traditional buffer cluster architectures.
3Productivity
If data is kept in buffer clusters during migration, then migration can proceed, but infrastructure costs and complexity increase
Solution Approach 1:
The patent extracts the buffering function from complex networked buffer cluster infrastructure and implements it using simple portable media devices. Instead of requiring sophisticated buffer clusters with multiple storage nodes, networking infrastructure, and management software, the system uses self-contained portable media (tape libraries, disk arrays, or solid-state drives) that can be physically transported. This extraction dramatically reduces device complexity while preserving migration capability.
Solution Approach 2:
The patent employs portable media that can be reused for multiple migration cycles but requires minimal infrastructure support. The media themselves are relatively simple, inexpensive components compared to buffer cluster infrastructure, and can be cycled through migration processes repeatedly. This approach reduces both device complexity and infrastructure costs while maintaining productive migration capability.
Data Source
AI summary
The present disclosure provides methods, systems, and non-transitory computer readable media for migrating data in a data storage system. A method for migrating data comprises: transferring data from a storage cluster in a first data center to a migration cartridge of the first data center; converting, by the migration cartridge of the first data center, the data's format into an archival format; storing the data into a media card; and moving the media card from the first data center to a second data center, wherein the data is read from the media card into a migration cartridge of the second data center and stored into an archival cluster in the second data center according to the archival format of the data.