Encoded Slice Rebuilding With Access-Controlled Vault Recovery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current dispersed storage networks face challenges in securely storing and retrieving data across multiple storage units while maintaining data integrity and security, particularly in scenarios where data loss or corruption occurs due to storage unit failures.

Innovation Solution

A dispersed storage network architecture that employs error encoding using Cauchy Reed-Solomon encoding, where data is segmented into encoded slices stored across multiple storage units, allowing for secure reconstruction of data even if some slices are lost or corrupted, with a managing unit overseeing vault creation, security, and rebuilding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is encoded and stored across multiple dispersed storage units, then data reliability and tolerance to storage unit failures are improved, but system complexity increases due to encoding and decoding operations

Engineering Contradiction:
Improvedata reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments data into multiple encoded slices using Cauchy Reed-Solomon encoding, distributing them across different storage units. This segmentation allows the system to tolerate storage unit failures while maintaining data reliability, as sufficient slices can be retrieved and decoded even if some storage units fail.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a managing unit as an intermediary that coordinates the encoding, storage, retrieval, and decoding operations. This managing unit simplifies the overall system complexity by centralizing the control of complex encoding/decoding operations, while the actual storage units remain relatively simple storage devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If data is segmented into multiple encoded slices for distributed storage, then tolerance to storage unit failures is improved, but data retrieval time increases due to需要从多个存储单元读取和重组数据

Engineering Contradiction:
Improvetolerance to storage unit failuresVSAvoiddata retrieval time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary encoding of data into multiple slices before distribution, and pre-establishes the mapping between slices and storage units. During retrieval, the system can immediately begin fetching slices from multiple storage units in parallel without needing to perform complex encoding operations, reducing retrieval time while maintaining failure tolerance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent retrieves only the minimum necessary number of slices (k slices out of n total slices) required to reconstruct the data, rather than retrieving all slices. This partial action approach reduces retrieval time by avoiding unnecessary data transfer, while still ensuring sufficient data is obtained for successful reconstruction even if some storage units fail.

Inventive Principle:
Principle #16Partial or excessive action

3Object-affected harmful factors

If secure encoding mechanisms are implemented for data protection, then data security is improved, but processing overhead and operation complexity increase

Engineering Contradiction:
Improvedata securityVSAvoidoperation complexity
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The patent uses Cauchy Reed-Solomon encoding which transforms data into a different mathematical representation (parameter change) that provides security and error correction capabilities. The encoding process changes the data from its original form into encoded slices that are mathematically related but not directly interpretable, providing security while the managing unit handles the complexity of the transformation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The encoded slices themselves contain inherent security properties through the mathematical structure of the encoding scheme. The data can only be reconstructed when sufficient slices are combined through the decoding process, providing security without requiring additional encryption layers. The system serves its own security needs through the encoding mechanism itself.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10133631B2Multi option rebuilding in a dispersed storage network
Publication Date: 2018.11.20 PURE STORAGE INC
  • US10133631B2 patent drawing
  • US10133631B2 patent drawing
  • US10133631B2 patent drawing

AI summary

A method includes identifying an encoded slice for rebuilding. The method further includes determining whether the set of encoded slices is stored in an encrypted section of a vault or within an unencrypted section of the vault. The method further includes, when the set of encoded slices is stored in the unencrypted section of the vault, determining whether the set of storage units have viewing rights. The method further includes, when the set of storage units does not have the viewing rights, enabling a restricted rebuilding process to rebuild the encoded slice. The method further includes, when the set or storage units does have the viewing rights, enable an unrestricted rebuilding process to rebuild the encoded slice.