Dispersed Storage Migration Using Encoded Data Slice Reallocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional RAID systems face challenges with disk failures, maintenance costs, data security, and vulnerability to natural disasters due to the co-location of storage units, which can lead to data loss and unauthorized access.

Innovation Solution

A dispersed storage network (DSN) that uses error encoding and decoding techniques, such as Cauchy Reed-Solomon encoding, to distribute data across multiple geographically dispersed storage units, ensuring data integrity and security by creating multiple encoded data slices that can be recovered even with partial failures, without the need for redundant copies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is stored in a RAID system with multiple disks, then data redundancy is improved, but security deteriorates due to multiple accessible copies

Engineering Contradiction:
Improvedata redundancyVSAvoidunauthorized access
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent segments data into multiple encoded slices distributed across different storage units. Instead of storing complete redundant copies like RAID, the data is divided and encoded such that no single storage unit contains the full data, making unauthorized access difficult while maintaining redundancy through distributed storage

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an encoding mechanism as an intermediary between the original data and stored copies. This encoding transforms the data into a form that requires multiple slices and decoding operations to reconstruct, thereby protecting against unauthorized access while preserving data redundancy

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If storage units are co-located for ease of access, then operation speed is improved, but vulnerability to natural disasters increases

Engineering Contradiction:
Improveaccess speedVSAvoidnatural disaster vulnerability
Core Design Contradiction:
SpeedVSObject-affected harmful factors

Solution Approach 1:

The patent segments data across multiple geographically dispersed storage units rather than co-locating redundant copies. This segmentation allows the system to maintain accessibility while distributing risk across different physical locations, reducing vulnerability to localized natural disasters

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from horizontal redundancy (multiple copies in the same location) to spatial distribution across different dimensions (geographic locations). This dimensional change allows the system to maintain data availability while protecting against location-specific disasters

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Quantity of substance

If more disks are added to RAID array for increased capacity, then storage capacity is improved, but maintenance costs increase due to higher failure probability

Engineering Contradiction:
Improvestorage capacityVSAvoidmaintenance cost
Core Design Contradiction:
Quantity of substanceVSEase of manufacture

Solution Approach 1:

The patent segments data across storage units and uses erasure coding to provide redundancy. This allows the system to efficiently utilize storage capacity without requiring excessive redundant disks, thereby reducing the probability of data loss and associated maintenance costs as capacity scales

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11740972B1Migrating data in a vast storage network
Publication Date: 2023.08.29 PURE STORAGE INC
  • US11740972B1 patent drawing
  • US11740972B1 patent drawing
  • US11740972B1 patent drawing

AI summary

Methods and apparatus for use in a storage network operate by: storing, in a first storage unit of a first set of storage units of the storage network, a first encoded data slice corresponding to at least one data object; assigning one or more additional storage units to the storage network to form a second set of storage units, the second set of storage units including the one or more additional storage units; migrating the first encoded data slice from the first storage unit to at least one of the one or more additional storage units of the second set of storage units; and reallocating a mapping of the first encoded data slice from the first storage unit to the at least one of the one or more additional storage units of the second set of storage units.