Proxy Slice Access During Storage Unit Data Evacuation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data evacuation processes in dispersed storage networks face inefficiencies, including unnecessary resource usage and reduced availability due to the transfer of deleted slices and incomplete data during unit replacement, leading to unnecessary rebuilding and incorrect version checks.

Innovation Solution

Implementing proxying of slice access requests during data evacuation, where the replacement storage unit forwards read and write requests to the retiring unit, and handles list requests locally to minimize network traffic and prevent incorrect operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data evacuation transfers all slices including deleted ones, then data integrity is maintained, but evacuation time and network resource usage increase

Engineering Contradiction:
Improvedata integrityVSAvoidevacuation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts and removes deleted slices from the evacuation process before transfer. The system identifies slices marked for deletion and excludes them from the data evacuation operation, transferring only active slices to the new storage unit. This reduces evacuation time and network resource usage while maintaining data integrity for active slices.

Inventive Principle:
Principle #2Taking out (Extraction)

2Loss of energy

If the replacement unit performs local list requests during evacuation, then network traffic is reduced, but the unit must maintain synchronization with the retiring unit

Engineering Contradiction:
Improvenetwork trafficVSAvoidsynchronization complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent introduces a proxy mechanism as an intermediary between the replacement unit and the retiring unit. The proxy handles list requests by forwarding them to the retiring unit and returning results to the replacement unit, allowing local list operations without direct network traffic between storage units while maintaining synchronization through the proxy mediator.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If checked write operations verify slice existence during evacuation, then data consistency is ensured, but operations fail when slices are in transit

Engineering Contradiction:
Improvedata consistencyVSAvoidwrite operation success rate
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent performs preliminary actions by pre-transferring slices before checked write operations are executed. The system initiates slice transfer from the retiring unit to the replacement unit before attempting write operations, ensuring that slices exist at the destination when verification is needed. This preliminary data positioning ensures data consistency while maintaining high write operation success rates.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If all slices are transferred during evacuation, then no rebuilding is needed, but network resources are wasted on deleted slices

Engineering Contradiction:
Improveevacuation completenessVSAvoidnetwork resource usage
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent extracts deleted slices from the evacuation process and separates them from active slices. By identifying slices marked for deletion beforehand, the system excludes them from network transfer operations, transferring only necessary active slices. This maintains evacuation completeness for active data while eliminating waste of network resources on deleted content.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10853173B2Proxying slice access requests during a data evacuation
Publication Date: 2020.12.01 PURE STORAGE INC
  • US10853173B2 patent drawing
  • US10853173B2 patent drawing
  • US10853173B2 patent drawing

AI summary

A method begins by a processing module receiving a checked write slice request from a requesting entity. The method continues by determining that locally stored encoded data slices do not include the requested encoded data slice. The method continues by identifying an alternate location for the requested encoded data slice. The method continues by determining whether the alternate location is associated with storage of the encoded data slice. The method continues when the alternate location is associated with the storage of the encoded data slice, by issuing a favorable checked write slice response to a requesting entity. The method can include facilitating transfer of the requested encoded data slice from the alternate location to the storage unit for storage.