Distributed Storage Network Data Integrity via Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer storage systems face challenges with data integrity and security due to the failure of memory devices, particularly those using physical movement technologies, which can lead to bit-level corruption and loss of data, and RAID systems face inefficiencies and security risks with increased maintenance demands and unauthorized access as data is replicated across multiple discs.

Innovation Solution

A distributed storage network that employs error-coded data slices, stored across multiple physically diverse locations, using a distributed storage processing unit to partition data into segments, encode them, and distribute them across multiple storage units, allowing for reliable and secure data retrieval and modification while maintaining data integrity through error correction and redundancy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is replicated across multiple discs in RAID systems, then data redundancy is improved, but security risks and maintenance demands increase

Engineering Contradiction:
Improvedata redundancyVSAvoidunauthorized access risk
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent segments data into multiple data slices and distributes them across different storage units. Each slice alone is insufficient to reconstruct the original data, providing security while maintaining redundancy. This resolves the contradiction by enabling data replication without the security risks of traditional RAID systems.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an error encoding intermediary layer that transforms data into encoded slices before storage. This intermediary encoding mechanism enables secure distribution across multiple locations while maintaining data integrity and redundancy, addressing both security concerns and reliability requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If data is replicated across multiple discs in RAID systems, then data redundancy is improved, but maintenance demands increase

Engineering Contradiction:
Improvedata redundancyVSAvoidmaintenance demands
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

By segmenting data into slices and distributing them across storage units, the system simplifies maintenance operations. Individual slices can be managed, replaced, or repaired independently without affecting the entire data set, reducing maintenance complexity while maintaining redundancy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The error encoding mechanism enables automatic data reconstruction and recovery. When data is lost or corrupted, the system can automatically reconstruct it from remaining slices without requiring complex manual intervention, reducing maintenance demands while preserving data redundancy.

Inventive Principle:
Principle #25Self-service

3Object-affected harmful factors

If error-coded data slices are distributed across multiple storage units, then data security is improved, but device complexity increases

Engineering Contradiction:
Improveunauthorized access protectionVSAvoidstorage system complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The error encoding intermediary provides a standardized interface for data transformation and distribution. This intermediary layer handles the complexity of encoding and distribution internally, presenting a simple interface to users while achieving enhanced security through distributed storage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The distributed storage system with error encoding serves multiple functions simultaneously: data security, redundancy, and automatic recovery. This multi-functionality consolidates what would otherwise require separate complex systems into a unified approach, managing complexity while providing comprehensive protection.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9304759B2Distributed storage network for modification of a data object
Publication Date: 2016.04.05 PURE STORAGE INC
  • US9304759B2 patent drawing
  • US9304759B2 patent drawing
  • US9304759B2 patent drawing

AI summary

A method for updating software in storage units of a dispersed storage network includes determining a software updating sequence pattern, which insures that, for each set of encoded data slices, a decode threshold number of encoded data slices is accessible. The method includes taking a set of the storage units off-line for software updating in accordance with the software updating sequence pattern. The method includes, when the software has been successfully updated in the set of storage units, putting the set of storage units back on-line and taking another set of the storage units off-line in accordance with the software updating sequence pattern. The method includes, when the software has been successfully updated in the other set of storage units, putting the other set of storage units back on-line and taking yet another set of the storage units off-line for software updating in accordance with the software updating sequence pattern.