Predictive Data Generation in Hybrid Cloud Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In hybrid cloud environments, copying large amounts of data between storage systems separated by a wide area network (WAN) is time-consuming due to bandwidth constraints, primarily for cost reasons.
Innovation Solution
A data generation control system that includes multiple storage devices and an administrative device, which identifies similar data and calculates predicted transmission times for basic and difference data. If the time for transmitting similar data is shorter, it prioritizes transmitting similar data and difference data to generate the target data, otherwise, it transmits basic data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is copied between storage systems via WAN, then data can be transmitted between separated storage systems, but the transmission time increases due to narrower bandwidth
Solution Approach 1:
The patent segments the data into basic data and difference data, allowing selective transmission of only the necessary portions. The administrative device identifies similar data between source and destination storage systems, then transmits only the difference data over the WAN, significantly reducing transmission time while maintaining complete data replication.
Solution Approach 2:
The patent performs preliminary identification of similar data before actual transmission. The administrative device compares data between storage systems in advance to determine what can be reused, preparing the transmission plan to only transfer necessary difference data, thereby optimizing transmission time.
2Reliability
If basic data is transmitted from generation source storage device, then complete data can be generated at destination, but transmission time increases due to larger data volume
Solution Approach 1:
The patent extracts only the essential difference data from the complete data set and transmits it to the generation destination storage device. The administrative device identifies similar data that can be reused and separates it from the difference data, allowing efficient transmission of minimal necessary information while ensuring complete data generation at the destination.
Solution Approach 2:
The patent uses copying of similar data from the generation source storage device to the generation destination storage device, then applies difference data to create the final target data. This copying approach allows rapid data generation by leveraging existing similar data rather than transferring complete data sets.
Data Source
AI summary
An administrative terminal receives designation of generation target data and of a generation destination storage device and identifies data similar to the target data. The terminal calculates a first predicted time expected for transmitting the target data from a storage device holding the target data to the generation destination storage device, and a second predicted time expected to be required for a second transmission process of transmitting the similar data from an object storage service to the generation destination storage device and of transmitting difference data between the target data and the similar data from the storage device holding the target data to the generation destination storage device. If the second predicted time is shorter than the first predicted time, the administrative terminal performs the second transmission process to transmit the similar data and the difference data to the generation destination storage device to generate the generation target data therein.