Multi-tenant Container Isolation via Segmentation and Mediator

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-tenant software containers face challenges in isolating tenants to prevent resource starvation, data access, and fault propagation, leading to potential system crashes or resource exhaustion.

Innovation Solution

Implementing resource isolation mechanisms, such as bytecode weaving and shadow environments, to monitor and manage resource usage, dependency isolation through tenant and container classloaders, and fault isolation by intercepting shutdown requests and limiting resource allocation, ensuring secure and stable operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If multiple tenants execute in the same multi-tenant software container to share common frameworks and reduce resource utilization, then resource efficiency is improved, but isolation between tenants deteriorates leading to potential resource starvation and system instability

Engineering Contradiction:
Improveresource utilizationVSAvoidsystem stability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent divides the multi-tenant container into isolated execution environments using virtualization techniques. Each tenant is assigned dedicated virtualized resources (CPU, memory, storage) that are segmented from other tenants, preventing resource starvation while maintaining the ability to share common frameworks. The container is partitioned into multiple isolated namespaces where each tenant operates independently with enforced resource limits.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary layer (container runtime and resource management system) that mediates between tenants and physical resources. This intermediary enforces resource allocation policies, monitors usage, and prevents any single tenant from consuming excessive resources. The intermediary acts as a gatekeeper that maintains system stability while enabling multi-tenant execution.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If basic isolation mechanisms are used in multi-tenant containers to simplify architecture, then device complexity is reduced, but security between tenants deteriorates allowing data access violations

Engineering Contradiction:
Improveisolation mechanism complexityVSAvoiddata access security
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The patent implements nested isolation layers where virtualization occurs within the container runtime, which itself runs on the host operating system. Multiple levels of abstraction are nested: host OS → container runtime → tenant execution environments. Each nested layer provides additional isolation, with the innermost layer (tenant namespace) providing the actual security boundaries while outer layers provide management and enforcement capabilities.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Adaptability or versatility

If resource allocation is allowed to be dynamic and flexible for different tenants, then adaptability is improved, but resource starvation of other tenants occurs

Engineering Contradiction:
Improveresource allocation flexibilityVSAvoidtenant service availability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamic resource allocation with enforced boundaries. Resource limits for each tenant are configured dynamically based on demand and service level agreements, allowing flexibility in how resources are distributed. However, these dynamic allocations operate within hard constraints that prevent any tenant from exceeding their allocated quota, ensuring that other tenants are not starved. The system dynamically adjusts resource distribution while maintaining reliability through enforced caps.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9754122B1Isolating tenants executing in multi-tenant software containers
Publication Date: 2017.09.05 AMAZON TECH INC
  • US9754122B1 patent drawing
  • US9754122B1 patent drawing
  • US9754122B1 patent drawing

AI summary

Technologies are described herein for isolating tenants executing in a multi-tenant software container. Mechanisms for resource isolation allow tenants executing in a multi-tenant software container to be isolated in order to prevent resource starvation by one or more of the tenants. Mechanisms for dependency isolation may be utilized to prevent one tenant executing in a multi-tenant software container from using another tenant in the same container in a manner that requires co-tenancy. Mechanisms for security isolation may be utilized to prevent one tenant in a multi-tenant software container from accessing protected data or functionality of another tenant. Mechanisms for fault isolation may be utilized to prevent tenants in a multi-tenant software container from causing faults or other types of errors that affect other tenants executing in the same software container.