IP Multicast Event Notifications for Dispersed Storage Status

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current dispersed storage networks face challenges in efficiently encoding and decoding data across multiple storage units, leading to potential data loss and security vulnerabilities due to the lack of robust error correction mechanisms and secure data management.

Innovation Solution

The implementation of a dispersed storage network with a managing unit and integrity processing unit that utilizes error encoding techniques like Cauchy Reed-Solomon encoding, along with a DSN interface module for secure data storage and retrieval, ensures data integrity and security by distributing data across multiple storage units and enabling automatic rebuilding of corrupted slices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is distributed across multiple storage units without error correction encoding, then storage capacity and accessibility are improved, but data reliability and security deteriorate due to potential data loss from storage unit failures

Engineering Contradiction:
Improvedata storage capacityVSAvoiddata reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments data into multiple encoded slices distributed across different storage units. Each data object is divided into K slices, which are then encoded using Cauchy Reed-Solomon encoding to generate N total slices (where N > K). These slices are distributed to N different storage units, allowing the system to store more data while maintaining reliability through the encoding mechanism.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies error correction encoding in advance to create redundant encoded slices before data is stored. The Cauchy Reed-Solomon encoding generates additional parity slices that can compensate for potential failures. This beforehand cushioning ensures that even if storage units fail, the original data can be reconstructed from the remaining slices.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Reliability

If error correction encoding is implemented across dispersed storage units, then data reliability is improved, but system complexity increases due to encoding and decoding operations

Engineering Contradiction:
Improvedata reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs error correction encoding in advance during the data storage process. The Cauchy Reed-Solomon encoding is applied once when data is initially distributed, creating all necessary encoded slices upfront. This preliminary action eliminates the need for complex real-time encoding operations during data retrieval, reducing operational complexity while maintaining high reliability.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If data is encoded and distributed across multiple storage units, then data security is improved, but data retrieval time increases due to coordination overhead

Engineering Contradiction:
Improvedata securityVSAvoiddata retrieval time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent enables storage units to autonomously decode and reconstruct data slices using the Cauchy Reed-Solomon decoding algorithm. When data needs to be retrieved, the system simply needs to gather K out of N encoded slices from any K storage units, and the decoding process automatically reconstructs the original data. This self-service capability reduces coordination overhead and retrieval time while maintaining strong security through distributed encoding.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10409514B2IP multicast message transmission for event notifications
Publication Date: 2019.09.10 PURE STORAGE INC
  • US10409514B2 patent drawing
  • US10409514B2 patent drawing
  • US10409514B2 patent drawing

AI summary

A method for a dispersed storage network (DSN) begins when storing data associated with a vault, by identifying a multicast IP address associated with the vault. The method continues by generating and sending a multicast IP message to a plurality of storage units of the DSN and extracting, by each storage unit receiving the multicast IP message, the multicast IP address. The method continues when the extracted IP address compares favorably to a subscribed IP address, by storing, by the storage unit, the one or more encoded data slices for storage and the corresponding slice name for each encoded data slice. The method continues by each storage unit issuing a status multicast IP message. The method continues when an extracted IP address of a plurality of received status multicast IP messages compares favorably to a subscribed IP address, by executing an associated task.