Shuttle Storage Data Migration in Distributed Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data migration methods in distributed storage systems are costly and time-consuming, especially when dealing with massive data quantities, and often result in data loss, unavailability, and lack of accountability, due to bandwidth limitations and the need for physical movement of storage devices.
Innovation Solution
A distributed storage system using shuttle storage devices that duplicate data locally and physically transport it to target locations, ensuring data availability, integrity, and traceability through information lifecycle management policies and encryption, while minimizing manual labor and optimizing storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is migrated via traditional means over non-local communication medium, then data can be transferred to off-site storage, but bandwidth limitations and costs make the process too costly and time-consuming
Solution Approach 1:
The patent segments the data migration process by dividing massive data sets into smaller chunks that can be loaded onto shuttle storage devices. Multiple shuttle devices can be deployed in parallel to different target locations, enabling concurrent migration of data segments. This segmentation allows the system to overcome bandwidth limitations by using multiple independent transfer channels simultaneously.
Solution Approach 2:
The patent introduces shuttle storage devices as intermediary carriers between source and target storage systems. These shuttles physically transport data copies to target locations, acting as mediators that bypass the limitations of network communication. The intermediary shuttles enable reliable data transfer without being constrained by network bandwidth or distance.
2Quantity of substance
If data is physically moved to off-site storage, then storage capacity is increased, but data availability during migration is lost and downtime occurs
Solution Approach 1:
The patent implements preliminary action by creating duplicate copies of data on shuttle storage devices before the actual migration process begins. The source storage system maintains active copies while shuttles are being prepared and transported. This preliminary duplication ensures that data remains accessible at the source location throughout the migration process, preventing downtime and maintaining productivity.
Solution Approach 2:
The patent applies discarding and recovering by temporarily using shuttle storage devices as intermediate storage carriers. The shuttles are loaded at the source, transported to target locations, and then discarded at the destination where their contents are transferred to permanent storage. This allows the source system to recover and continue operating with full data availability while the shuttles complete their migration task.
3Adaptability or versatility
If massive quantities of data are migrated, then storage consolidation is achieved, but the bulk and scale of data make traditional migration methods too costly and error-prone
Solution Approach 1:
The patent implements self-service by enabling the distributed storage system to automatically manage the migration process. The control system autonomously selects data for migration, assigns shuttle devices, monitors transfer progress, and verifies data integrity. This automated self-service approach eliminates the need for complex manual intervention, reducing operational complexity while handling massive data quantities efficiently.
Solution Approach 2:
The patent applies universality by designing shuttle storage devices that can serve multiple functions: they act as data carriers, temporary storage units, and verification checkpoints. The same shuttle infrastructure can be reused for different migration tasks and target locations, providing a universal solution that handles various data consolidation scenarios without requiring specialized equipment for each case.
4Reliability
If redundant copies of data are stored to reduce data loss probability, then reliability is improved, but the resources necessary to manage the storage system increase
Solution Approach 1:
The patent implements feedback mechanisms where the control system continuously monitors the status of shuttle storage devices, data transfer progress, and target storage system readiness. This feedback enables automated decision-making about when to deploy shuttles, when to verify data integrity, and when to initiate recovery procedures. The feedback loop manages redundant copies efficiently by triggering actions only when needed, reducing unnecessary management overhead.
Data Source
AI summary
A method and system for migrating massive amounts of data in a secure and traceable fashion using a distributed storage system is described. Data shuttle storage devices moves large quantities of content from one source location to one or more target locations by first acting in local communication with the source location, then being physically moved to a location where a shuttle storage device may be in local communication with the target location. This migration does not compromise data accessibility, reliability, or security. Dynamic configurable policy-driven data placement specifies the number and location of multiple copies of each digital data object. Each digital data object replica remains traceable even as the hardware onto which it is stored is being relocated. The content remains accessible at any time.