Encoded Data Slice Storage for Reliable Distributed Data Protection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional data storage systems face challenges with data integrity and security due to the failure of physical movement-based memory devices, such as disc drives, and the inefficiencies and security risks associated with redundant array of independent discs (RAID) solutions, which increase maintenance demands and expose data to unauthorized access.

Innovation Solution

A distributed storage system that employs error-coded data slices stored across multiple geographically diverse locations, using a dispersed storage network with a processing module that partitions data into segments, encodes them using forward error correction, and distributes them across multiple storage units, ensuring data integrity and security through redundancy and secure access control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If redundant array of independent discs (RAID) is used to protect against data loss, then data reliability is improved, but device complexity and maintenance demands increase

Engineering Contradiction:
Improvedata reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments data into multiple independent slices distributed across different storage units, replacing the monolithic RAID array structure. Each slice can be independently stored, retrieved, and managed, eliminating the need for complex RAID controller logic while maintaining data redundancy through cryptographic slicing and distributed storage across multiple units.

Inventive Principle:
Principle #1Segmentation

2Reliability

If multiple copies of data are stored to prevent data loss, then data reliability is improved, but security risks increase due to unauthorized access

Engineering Contradiction:
Improvedata reliabilityVSAvoidunauthorized access
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by encrypting data slices with unique cryptographic keys specific to each storage unit. Each slice is protected by its own key, so that compromise of one storage unit does not expose other data. This localized cryptographic protection maintains reliability through redundancy while mitigating security risks by isolating access credentials to individual units rather than requiring a master key for all copies.

Inventive Principle:
Principle #3Local quality

3Quantity of substance

If physical movement-based memory devices are used, then storage capacity is improved, but data integrity deteriorates due to device failures

Engineering Contradiction:
Improvestorage capacityVSAvoiddata integrity
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent implements beforehand cushioning by incorporating cryptographic error detection and correction codes into each data slice before storage. These cryptographic checksums are calculated in advance and stored with each slice, enabling automatic detection and correction of data corruption without requiring physical intervention or replacement of storage devices. This pre-built protective layer cushions against the inherent unreliability of physical storage media while maintaining large storage capacity.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS11416179B1Storage unit solicitation for encoded data slice storage
Publication Date: 2022.08.16 PURE STORAGE INC
  • US11416179B1 patent drawing
  • US11416179B1 patent drawing
  • US11416179B1 patent drawing

AI summary

A method includes obtaining, by a computing device of a storage network, data for storage and interpreting metadata associated with the data to determine data storage requirements. The method further includes selecting a plurality of storage units of the storage network as target storage units based on the data storage requirements and a storage sequence and transmitting a solicitation message to the target storage units. The method further includes receiving favorable responses from at least some of target storage units, selecting storage units from the at least some of the target storage units to produce a set of selected storage units, determining an error coding dispersal storage function, encoding a data segment of the data in accordance with the error coding dispersal storage function to produce a plurality of encoded data slices, and outputting the plurality of encoded data slices to the set of selected storage units for storage therein.