Distributed Storage Network Vault Encoding for Data Integrity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing storage systems face challenges in ensuring data availability and integrity in the event of memory device failure, particularly in commercial-grade systems using technologies with physical movement, such as disc drives.

Innovation Solution

The proposed solution involves a distributed storage network (DSN) that uses error-coded data slices and a dispersed storage processing unit to store and retrieve data across multiple physically diverse storage units, ensuring data integrity and availability even in the event of individual storage device failures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is stored in a single memory device, then storage simplicity is maintained, but data availability and integrity are compromised in the event of device failure

Engineering Contradiction:
Improvedata availabilityVSAvoidstorage system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides data into multiple data slices and stores them across different memory devices. This segmentation allows the system to maintain data availability even if individual devices fail, as the data is distributed and can be reconstructed from remaining slices.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary encoding layer that processes data before storage. By applying error correction codes and dispersal algorithms as intermediaries, the system enables reliable data recovery from distributed slices, resolving the contradiction between simplicity and reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If data is replicated across multiple storage devices, then data availability is improved, but storage efficiency deteriorates due to redundant data

Engineering Contradiction:
Improvedata availabilityVSAvoidstorage efficiency
Core Design Contradiction:
ReliabilityVSLoss of substance

Solution Approach 1:

The patent transforms the storage approach by changing the parameter of data representation through error correction encoding. Instead of storing redundant copies, the system stores encoded slices where the mathematical relationships between slices enable recovery without physical duplication, improving storage efficiency while maintaining availability.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses a sophisticated form of copying where data is dispersed into multiple slices that collectively represent the original data. Rather than creating identical copies, the system creates complementary fragments that can be mathematically recombined, reducing storage overhead while ensuring data availability.

Inventive Principle:
Principle #26Copying

3Reliability

If error correction codes are applied to all data, then data integrity is improved, but processing overhead increases

Engineering Contradiction:
Improvedata integrityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies error correction selectively rather than uniformly to all data. By using dispersal algorithms that distribute protection across multiple slices, the system achieves comprehensive data integrity with reduced per-slice processing overhead, as each slice carries partial correction information.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent performs error correction encoding in advance during the data writing phase. By applying dispersal algorithms and error correction codes before data is stored, the system prepares the data structure to automatically withstand failures during read operations, reducing processing overhead during data retrieval and improving overall productivity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250158836A1Storage of Data and Metadata in a Storage Network
Publication Date: 2025.05.15 PURE STORAGE INC
  • US20250158836A1 patent drawing
  • US20250158836A1 patent drawing
  • US20250158836A1 patent drawing

AI summary

Methods and apparatus for storing data and metadata in a storage network. In a method, one or more processing modules of a storage network establishes a vault as a virtual memory block that maps to memory of the storage network. The method further includes receiving data for storage in the vault, selecting a first vault parameter set regarding distributed storage of the data, and encoding at least a portion of the data in accordance with the first vault parameter set to produce a set of encoded data slices. The method further includes obtaining metadata regarding the set of encoded data slices, selecting a second vault parameter set regarding distributed storage of the metadata, and encoding the metadata in accordance with the second vault parameter set to produce metadata encoded slices. The method further includes facilitating storage of the set of encoded slices and the metadata encoded slices in the vault.