Cloud Data Recall via Partial Object Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Integrating cloud services with conventional storage devices is challenging due to differences in operations, with existing systems struggling to efficiently manage data access and transfer between the two, leading to inefficiencies and delays, especially when dealing with large files or frequently accessed data.
Innovation Solution
The system intercepts access requests, modifies metadata to indicate data availability, and prioritizes cloud object transfers, allowing partial data access without waiting for complete file transfer, using flags to track modified data and maintaining point-in-time versions for efficient data management between cloud and storage devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is migrated to cloud service for storage, then storage capacity and accessibility are improved, but data access speed and availability are worsened due to transfer delays
Solution Approach 1:
The patent segments data into multiple objects and enables selective retrieval of individual objects or portions rather than requiring complete file transfer. The system divides data into manageable units that can be independently accessed, allowing partial data access while cloud objects are being transferred, thus resolving the contradiction between storage capacity and access speed.
Solution Approach 2:
The system performs preliminary actions by initiating cloud object transfers in the background before actual data access is needed. Metadata is updated to reflect data availability status, and the system proactively transfers cloud objects to local storage in anticipation of access requests, reducing perceived wait time and improving data access speed while maintaining cloud storage capacity.
2Reliability
If complete file transfer is required before data access, then data integrity is improved, but access delay and operational efficiency are worsened
Solution Approach 1:
The patent implements partial action by allowing data access operations to proceed with only a portion of the complete file transferred. The system retrieves and accesses specific cloud objects or data portions without waiting for the entire file to be transferred, reducing access delay while maintaining data integrity through metadata validation and selective retrieval of necessary data components.
Solution Approach 2:
The system introduces metadata as an intermediary layer that tracks data availability status, object transfer progress, and access permissions. This metadata intermediary enables the system to manage partial data access safely, coordinating between cloud storage, local cache, and access operations without compromising data integrity while minimizing access delays.
3Reliability
If all cloud objects are transferred before access, then data availability is improved, but system productivity and response time are worsened
Solution Approach 1:
The system dynamically adjusts data availability based on actual access needs rather than requiring complete transfer beforehand. Cloud objects are transferred and made available on-demand or in priority order based on access patterns, allowing the system to maintain data availability for critical operations while improving productivity by avoiding unnecessary transfer of non-accessed data.
Solution Approach 2:
The system implements feedback mechanisms by monitoring access patterns, object transfer status, and data availability requirements. This feedback enables dynamic prioritization of cloud object transfers, where frequently accessed or critical data objects are transferred first, improving system productivity while maintaining adequate data availability for operational needs.
Data Source
AI summary
Accessing a portion of data that was previously migrated to a cloud service includes initiating a recall of the data from the cloud service in response to the data residing entirely on the cloud service, determining if the portion of the data is stored on the storage device, retrieving cloud objects from the cloud service corresponding to the portion of the data in response to the portion of the data being unavailable on the storage device, and accessing the portion of the data on the storage device while cloud objects corresponding to other portions of the data are being transferred from the cloud service to the storage device. The host may receive a migrated status indicator in response to the data existing entirely on the cloud service. Initiating the recall may include modifying metadata to indicate that the data is available for access by the host.