Data Storage Manager for Logical Volume Access via Dynamic Rules

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In distributed computing environments, scalability and availability of block-level storage systems are complex due to the involvement of multiple devices with different interfaces, leading to challenges in managing storage resources efficiently and ensuring fault tolerance.

Innovation Solution

A data storage manager system that maintains a set of rules mapping blocks of a logical data storage volume to their storage locations, allowing direct access by host computing devices and enabling fault-tolerant operation by instantiating new managers as needed, with predictive allocation of storage resources and independent software updates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a distributed block-level storage system uses multiple devices with different interfaces to improve storage capacity and scalability, then the quantity of storage resources increases, but the device complexity and difficulty of managing storage resources increases

Engineering Contradiction:
Improvestorage capacityVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces a data storage manager as an intermediary component that sits between the host computing device and the distributed storage devices. This manager maintains a namespace mapping the logical data storage volume to physical storage locations across multiple devices with different interfaces, abstracting the complexity of managing heterogeneous storage devices while enabling scalable storage capacity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If the storage system uses multiple distributed devices to improve scalability, then the storage capacity increases, but the availability and fault tolerance become more complex to ensure

Engineering Contradiction:
Improvestorage capacityVSAvoidavailability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The data storage manager acts as a centralized coordinator that tracks the location and status of data across distributed devices. It maintains namespace mappings that enable the system to locate and access data regardless of which specific device holds it, thereby simplifying fault tolerance mechanisms in a scalable distributed environment.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the storage system into independent logical units (namespaces) that can be mapped to different physical devices. This segmentation allows the system to distribute data across multiple devices while maintaining independent access paths, improving both scalability and availability.

Inventive Principle:
Principle #1Segmentation

3Speed

If the system maintains a complete set of rules mapping all blocks to storage locations to enable direct access, then the access speed improves, but the amount of memory required to store the rules increases

Engineering Contradiction:
Improveaccess speedVSAvoidmemory usage
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The namespace is segmented into manageable mappings that are maintained by the data storage manager. Rather than requiring the host to maintain complete rule sets for all possible blocks, the system divides the mapping task into segments that can be stored and managed efficiently, enabling direct access without excessive memory requirements.

Inventive Principle:
Principle #1Segmentation

4Speed

If the system allows direct access to storage nodes by hosts to reduce latency, then the access performance improves, but the ability to perform independent software updates and maintenance decreases

Engineering Contradiction:
Improveaccess performanceVSAvoidsoftware update capability
Core Design Contradiction:
SpeedVSEase of manufacture

Solution Approach 1:

The data storage manager serves as an intermediary layer that enables direct host access to storage nodes for performance while simultaneously providing a control plane for independent software updates and maintenance. The manager maintains the namespace mappings that enable direct access, while also coordinating updates without impacting data integrity or access performance.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11507283B1Enabling host computer systems to access logical volumes by dynamic updates to data structure rules
Publication Date: 2022.11.22 AMAZON TECH INC
  • US11507283B1 patent drawing
  • US11507283B1 patent drawing
  • US11507283B1 patent drawing

AI summary

A data storage manager may manage storage locations for blocks of a storage volume. The blocks of the storage volume may be assigned to a logical volume exposed to a computing instance supported by a host. Furthermore, the data storage manager may also generate and maintain a set of rules that specify the locations of blocks of the storage volume, and provides the set of rules to the host. The set of rules may be included in a data structure enabling the host to access the blocks based at least in part on the information included in the set of rules.