Encoded Data Slice Storage Adaptation for Changing Network Parameters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current dispersed storage networks face challenges in efficiently managing data dispersal characteristics and error encoding, particularly in maintaining data integrity and reliability across geographically distributed storage units without redundant copies, while also optimizing storage efficiency and security.

Innovation Solution

The implementation of a dispersed storage network that utilizes error encoding techniques, such as Cauchy Reed-Solomon encoding, to split data into encoded slices, which are then stored across multiple storage units, allowing for data recovery with a decode threshold, and dynamically modifies storage parameters to enhance reliability and efficiency based on measured conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is split into encoded slices and stored across multiple storage units using error encoding techniques, then data integrity and reliability are improved, but storage efficiency and system complexity worsen

Engineering Contradiction:
Improvedata integrityVSAvoidstorage system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides data into multiple encoded slices using error encoding techniques (e.g., Cauchy Reed-Solomon encoding). Each slice is stored in a separate storage unit, allowing the system to tolerate failures of multiple storage units while maintaining data integrity. This segmentation approach directly improves reliability by distributing risk across multiple independent storage locations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts storage parameters such as the decode threshold and dispersal characteristics based on measured conditions including storage unit availability, network conditions, and security requirements. By changing these parameters adaptively, the system optimizes the balance between reliability and storage efficiency rather than using fixed encoding schemes.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If storage parameters are dynamically modified based on measured conditions, then adaptability and reliability are improved, but system complexity and computational overhead worsen

Engineering Contradiction:
Improvestorage parameter adaptabilityVSAvoidparameter management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously measures storage conditions (such as storage unit availability, network latency, and security threats) and uses these measurements to dynamically adjust storage parameters. The measured data feeds back to the encoding/decoding process, enabling adaptive optimization of the decode threshold and dispersal characteristics based on actual system state.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transforms static storage parameters into dynamic ones that can change based on measured conditions. The decode threshold and dispersal characteristics are no longer fixed but are adjusted in real-time according to system measurements, allowing the system to adapt to changing conditions such as storage unit failures, network variations, and security requirements.

Inventive Principle:
Principle #15Dynamics

3Quantity of substance

If redundant copies are eliminated in favor of error-encoded slices, then storage efficiency is improved, but data recovery complexity worsens

Engineering Contradiction:
Improvestorage space utilizationVSAvoiddata recovery complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent replaces traditional redundant copying (where multiple identical copies of data are stored) with error-encoded slices. Instead of storing duplicate copies that consume additional space, the system encodes data into multiple slices where any sufficient subset can be used to recover the original data. This approach achieves redundancy with better storage efficiency while managing complexity through standardized encoding/decoding processes.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11556435B1Modifying storage of encoded data slices based on changing storage parameters
Publication Date: 2023.01.17 PURE STORAGE INC
  • US11556435B1 patent drawing
  • US11556435B1 patent drawing
  • US11556435B1 patent drawing

AI summary

A method includes determining a change to storage parameters associated with storage of data objects in a storage network, where a data segment of the data objects is dispersed storage error encoded into a set of encoded data slices based on dispersed storage error encoding parameters, and where the set of encoded data slices is stored in the set of storage units. The method also includes determining a storage modification process for the set of encoded data slices based on the change to the storage parameters. The method also includes executing the storage modification process such that the set of encoded data slices are stored in the storage network in accordance with the changed storage parameters.