Concurrent Data Retrieval from Multiple Cloud Storage Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data retrieval from cloud storage is often time-consuming, leading to potential delays in data recovery during system failures, as existing methods rely on sequential reading from primary devices and do not efficiently utilize concurrent retrieval from multiple storage devices.

Innovation Solution

Implementing a method for concurrent data retrieval from multiple cloud storage devices, where stripes of target data and redundancy data are retrieved simultaneously from different network storage devices, allowing for data reconstruction to initiate before all data is fully received.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If sequential reading from primary devices is used, then data retrieval process is simple, but data retrieval time is long

Engineering Contradiction:
Improvedata retrieval timeVSAvoiddata retrieval process complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by initiating data retrieval from multiple cloud storage devices simultaneously before all data is fully received. The data reconstruction process begins in parallel with the retrieval process, rather than waiting for complete data collection, thereby reducing overall retrieval time without requiring complex coordination protocols

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The data is segmented into stripes that are distributed across multiple cloud storage devices. Each device stores portions of the target data or redundancy data, allowing the client to retrieve segments concurrently from multiple sources and reconstruct the original data from these distributed segments

Inventive Principle:
Principle #1Segmentation

2Productivity

If concurrent retrieval from multiple storage devices is implemented, then data retrieval speed is improved, but system complexity increases

Engineering Contradiction:
Improvedata retrieval speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The client initiates data retrieval from multiple cloud storage devices concurrently and begins the data reconstruction process before all data stripes are fully received. This preliminary action approach allows the system to overlap retrieval and reconstruction operations, improving productivity while managing complexity through straightforward parallel execution

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system retrieves more data than strictly necessary by concurrently fetching both target data stripes and redundancy data from multiple devices. This excessive action ensures that sufficient data is available for reconstruction even if some retrieval operations complete later, simplifying the control logic while maintaining high retrieval speed

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10031807B2Concurrent data retrieval in networked environments
Publication Date: 2018.07.24 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10031807B2 patent drawing
  • US10031807B2 patent drawing
  • US10031807B2 patent drawing

AI summary

Embodiments of the present invention provide methods, systems, and program products for concurrent data retrieval from multiple loud storage devices. Embodiments of the present invention can be used to retrieve stripes of target data from at least a first network device, retrieve redundancy data of the target data from a second network storage device that is different from the first network storage device concurrently and reconstructing the target data based on the stripes of the target data and the redundancy data.