Tiered Memory Storage for Faster Encoded Slice Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data storage systems face inefficiencies in servicing all types of data access requests and status checks, often resulting in prohibitive response times due to limitations in communication between devices.

Innovation Solution

A dispersed storage network (DSN) utilizing fast memory devices and error encoding techniques, such as Cauchy Reed-Solomon encoding, to distribute and encode data across multiple storage units, ensuring data integrity and availability even with storage unit failures, and using fast memory for rapid access to slice names and status lists.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is stored in dispersed storage units with error encoding, then data integrity and availability are improved, but response time for data access requests deteriorates

Engineering Contradiction:
Improvedata integrityVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments data into multiple encoded slices distributed across different storage units. Each slice is independently stored with error encoding capabilities, allowing the system to maintain data integrity while enabling parallel access operations. The segmentation allows fast memory to store metadata about slices without requiring the actual data to be present, thus improving response time while maintaining reliability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary actions by pre-storing slice names, statuses, and metadata in fast memory before actual data access requests occur. This allows the system to quickly determine data availability and initiate retrieval processes without waiting for slow storage unit responses, thereby reducing overall response time while maintaining data integrity through pre-verified error encoding.

Inventive Principle:
Principle #10Preliminary action

2Loss of time

If fast memory is used for rapid access to slice names and status lists, then response time is reduced, but memory capacity and cost increase

Engineering Contradiction:
Improveresponse timeVSAvoidmemory capacity
Core Design Contradiction:
Loss of timeVSQuantity of substance

Solution Approach 1:

The patent applies local quality by storing only critical metadata (slice names, statuses, and availability information) in fast memory, while the actual data slices remain in slower, higher-capacity storage units. This selective placement of information based on access frequency and criticality optimizes response time for status checks without requiring fast memory to have sufficient capacity for all data, thus balancing speed requirements with memory capacity constraints.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11327689B1Storage unit including memories of different operational speeds for optimizing data storage functions
Publication Date: 2022.05.10 PURE STORAGE INC
  • US11327689B1 patent drawing
  • US11327689B1 patent drawing
  • US11327689B1 patent drawing

AI summary

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. A computing device receives a data access request for an encoded data slice (EDS) associated with a data object. The computing device compares a slice name of the data access request with slice names stored within RAM. When the data access request slice name compares unfavorably with those stored slice names, the computing device transmits an empty data access response that includes no EDS to the other computing device without needing to access a hard disk drive (HDD) that stores EDSs. Alternatively, the computing device transmits a data access response that includes the EDS.