Dispersed Storage Network Vault Provisioning and Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data storage systems in distributed networks lack efficient means to manage additional storage without affecting overall system operation, particularly in terms of error encoding and decoding processes.

Innovation Solution

A dispersed storage network (DSN) with a managing unit and integrity processing unit that uses error encoding and decoding protocols, such as Cauchy Reed-Solomon, to distribute data across multiple storage units, ensuring data integrity and availability even with storage unit failures, and allowing for secure and efficient storage and retrieval of data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If additional storage units are added to the distributed storage system, then storage capacity is increased, but system complexity and management difficulty increase

Engineering Contradiction:
Improvestorage capacityVSAvoidsystem management complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent segments the storage system into independent storage units that can be individually managed. Each storage unit operates autonomously with its own error encoding/decoding capabilities, allowing the system to scale by simply adding more segmented units without proportionally increasing overall management complexity. The managing unit coordinates these segmented units through standardized protocols.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universal error encoding and decoding protocols that work across all storage units regardless of their specific characteristics. This multi-functionality allows different storage units to be managed through a common framework, reducing the complexity increase that would normally accompany added storage capacity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If error encoding and decoding processes are implemented across all storage units, then data integrity is improved, but processing time and computational overhead increase

Engineering Contradiction:
Improvedata integrityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies error encoding to data before it is distributed to storage units, performing the computationally intensive encoding operation in advance. This preliminary action ensures data integrity is built-in before storage, while the actual retrieval process only requires simpler decoding operations, reducing the time penalty during critical read/write operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The managing unit acts as an intermediary that coordinates error encoding and decoding operations across storage units. By centralizing the coordination function while distributing the actual encoding/decoding to individual units, the system achieves data integrity without requiring all units to simultaneously perform complex processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If data is dispersed across multiple storage units, then system availability and fault tolerance are improved, but data retrieval complexity increases

Engineering Contradiction:
Improvesystem availabilityVSAvoiddata retrieval complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms where storage units report their status and data location to the managing unit. This feedback system enables the managing unit to track where data slices are stored across the distributed units, simplifying the retrieval process by providing centralized knowledge of data locations without requiring complex peer-to-peer discovery protocols.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The managing unit serves as an intermediary that handles the complexity of coordinating data retrieval across multiple dispersed storage units. It receives retrieval requests, determines which units hold the necessary data slices, and orchestrates the reconstruction process, thereby shielding end users from the underlying retrieval complexity while maintaining high availability through distributed storage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11604587B1Processing of a vault provisioning request within a data storage system
Publication Date: 2023.03.14 PURE STORAGE INC
  • US11604587B1 patent drawing
  • US11604587B1 patent drawing
  • US11604587B1 patent drawing

AI summary

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. The computing device receives, from another computing device, a vault provisioning request and processes the vault provisioning request to determine whether the other computing device is authorized to request provisioning of another vault within the DSN. When the other computing device is authorized, the computing device generates a vault within the DSN in response to the vault provisioning request from the other computing device and updates access control information within the DSN to include an initial access control for the vault and an identifier of the other computing device.