In-band Communication Channels for Distributed Storage State Exchange

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In existing distributed storage environments, client computing devices lack efficient mechanisms to respond to system events such as storage server updates or failover changes, leading to increased I/O latency and resource management challenges due to inadequate access to state information.

Innovation Solution

Implementing in-band communication channels between storage servers and client computing devices to exchange state information, enabling event notifications about server updates, failover changes, and resource availability, allowing for more efficient load balancing and resource management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If client computing devices use traditional out-of-band notification mechanisms, then system events can be notified, but I/O latency increases and resource management efficiency deteriorates

Engineering Contradiction:
Improvesystem availabilityVSAvoidI/O latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent introduces an in-band communication channel as an intermediary mechanism that allows storage servers to send event notifications directly to client computing devices through the existing I/O communication path. This eliminates the need for separate out-of-band notification channels, reducing the time delay for event notification while maintaining system reliability. The in-band channel acts as a mediator that efficiently transports event information alongside data I/O operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If client computing devices lack access to state information, then system complexity is reduced, but the ability to respond to system events deteriorates

Engineering Contradiction:
Improvecommunication mechanism complexityVSAvoidresponse capability to system events
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent makes the existing in-band communication channel multi-functional by using it for both traditional I/O data transmission and event notification purposes. This universal approach allows the same communication infrastructure to serve dual functions, enabling clients to receive state information without adding separate complex notification infrastructure. The in-band channel becomes a universal pathway for both data and control information.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of manufacture

If traditional communication channels are used, then implementation simplicity is maintained, but resource management efficiency deteriorates

Engineering Contradiction:
Improveimplementation simplicityVSAvoidresource management efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent merges event notification functionality with the existing in-band I/O communication channel, combining two previously separate functions into a single unified communication pathway. This merging approach maintains implementation simplicity by reusing existing infrastructure while simultaneously improving resource management efficiency through better utilization of the communication channel for both data transfer and event notification purposes.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11272005B1Communicating state information in a distributed storage environment
Publication Date: 2022.03.08 AMAZON TECH INC
  • US11272005B1 patent drawing
  • US11272005B1 patent drawing
  • US11272005B1 patent drawing

AI summary

Techniques are described for using in-band communication channels to exchange state information between components of a distributed storage environment, including between client computing devices and storage servers hosting network-connected block storage volumes. The exchange of the state information can be used, for example, to inform client computing devices of relevant events involving one or more storage volumes attached to compute instances (for example, virtual machines (VMs)) running on the client computing devices, involving one or more failover servers storing backup copies of one or more storage volumes, or involving any other relevant system components. The exchange of such state information in a distributed storage environment enables client computing devices, storage servers, and other system components to act efficiently in response to a variety of system events thereby mitigating input/output (I/O) latency increases and other issues that can arise when system components lack access to such information.