Reserved Storage Data Cache for Cloud Provider Substrate Extensions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud computing systems face delays and increased bandwidth usage due to the time-consuming transfer of large data, such as machine images, between distinct computing systems, which affects responsiveness and efficiency.

Innovation Solution

Implementing a reserved capacity data cache within a provider substrate extension (PSE) to store potentially needed data locally, reducing reliance on remote cloud provider networks by utilizing otherwise unused reserved storage capacity for caching, and managing this cache through eviction policies to ensure primary functionality is maintained.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data is transferred between distinct computing systems, then data access is achieved, but transfer time increases and bandwidth usage increases

Engineering Contradiction:
Improvedata retrieval speedVSAvoiddata transfer time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary actions by caching data in the reserved storage capacity of the PSE before it is needed. Machine images and other data are pre-positioned in the extension's local storage, so when a compute instance needs to access them, the data is already there, eliminating transfer time and improving speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The PSE acts as an intermediary between the cloud provider network and compute instances. Instead of direct transfers between distant systems, data flows through the PSE's local storage, which mediates the access and reduces the need for long-distance data transfers, thereby reducing bandwidth usage and transfer time.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If data is cached in reserved storage capacity, then data access speed improves, but storage capacity availability may be reduced

Engineering Contradiction:
Improvedata access efficiencyVSAvoidavailable storage capacity
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The system uses self-service by utilizing the PSE's own reserved storage capacity for caching purposes. The extension serves its dual function of providing both primary storage services and local caching, eliminating the need for separate dedicated cache infrastructure and maintaining storage availability through intelligent resource management.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The reserved storage capacity of the PSE is made multi-functional, serving both as primary storage for the extension's operations and as a cache for frequently accessed data. This universal use of storage resources maximizes productivity without requiring additional dedicated storage infrastructure.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If remote data transfer is performed, then data accessibility is maintained, but bandwidth consumption increases

Engineering Contradiction:
Improvedata accessibilityVSAvoidbandwidth usage
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The system applies local quality by caching data locally in the PSE's storage capacity rather than relying on remote transfers. Compute instances access data from the local PSE storage when possible, reducing the need for long-distance bandwidth consumption while maintaining full data accessibility. The PSE manager tracks which data is cached locally and manages access accordingly.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12111739B1Data caching in reserved storage capacity of cloud provider network extensions
Publication Date: 2024.10.08 AMAZON TECH INC
  • US12111739B1 patent drawing
  • US12111739B1 patent drawing
  • US12111739B1 patent drawing

AI summary

Systems and methods are described for use of reserved storage capacity at a cloud provider network extension, sometimes referred to as a provider substrate extension (“PSE”) or “outpost”, as a data cache, thereby improving performance of the PSE. The reserved storage capacity may be reserved for a primary purpose, such as data replication in the event of failure of an in-use portion of the PSE's storage capacity. During non-failover operation, the reserved storage capacity may be otherwise unused. Embodiments of the present disclosure enable the reserved storage capacity, when not used for its primary purpose, to be used as a data cache to store information potentially used at the PSE.