Intermediate Instruction Set Architecture for Heterogeneous Resource Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In heterogeneous compute environments, existing resource management systems struggle to provide unified and adaptive resource allocation across different hardware platforms and operating systems, leading to inconsistent resource control and enforcement, especially in edge computing scenarios where diverse devices with varying capabilities are deployed.

Innovation Solution

A method that utilizes an intermediate instruction set architecture (IISA) for resource monitoring and allocation, allowing for automated and adaptive resource management independently of hardware platforms and operating systems, enabling consistent resource enforcement and isolation between applications through a runtime environment that can override operating system functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional operating system-based resource management mechanisms (e.g., cgroups) are used, then resource control can be enforced on homogeneous systems, but the system loses adaptability when deployed on heterogeneous devices with different operating systems and capabilities

Engineering Contradiction:
ImproveadaptabilityVSAvoidreliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediate instruction set architecture (IISA) as a mediator between the runtime environment and the underlying operating system. The IISA serves as a unified abstraction layer that translates resource management requests into platform-specific operations, enabling consistent resource control across heterogeneous devices without depending on OS-specific mechanisms like cgroups. This intermediary layer resolves the contradiction by providing both adaptability to different platforms and reliable enforcement through standardized instructions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The runtime environment implements universal resource management capabilities through the IISA, allowing the same resource allocation and monitoring mechanisms to function across diverse hardware platforms and operating systems. The IISA provides multi-functional support for various resource types (CPU, memory, network, storage) and can be adapted to different device capabilities, achieving both broad adaptability and consistent reliability through a single unified approach.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If resource management is adapted to each individual hardware platform and operating system, then resource control can be optimized for each platform, but the device complexity increases significantly

Engineering Contradiction:
ImproveproductivityVSAvoidcomplexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the resource management function into two distinct parts: the universal IISA layer that handles standardized resource control logic, and the platform-specific execution layer that implements the actual resource allocation. This segmentation allows the complex platform-specific details to be isolated from the universal resource management logic, reducing the complexity burden on the runtime environment while maintaining optimized performance for each platform through the execution layer.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If a unified resource management approach is implemented across heterogeneous systems, then adaptability improves, but the ability to enforce resource policies consistently across different platforms deteriorates

Engineering Contradiction:
ImproveadaptabilityVSAvoidprecision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The IISA acts as a precise intermediary that maintains manufacturing precision in resource policy enforcement while enabling adaptability. It translates high-level resource policies into platform-specific instructions with sufficient precision to enforce constraints consistently, while simultaneously adapting to different hardware capabilities. The intermediary ensures that resource allocation decisions made at the unified level are executed with the necessary precision at the platform level.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240272927A1Method for resource allocation for applications and/or application containers in a distributed system of heterogeneous compute nodes
Publication Date: 2024.08.15 ROBERT BOSCH GMBH
  • US20240272927A1 patent drawing
  • US20240272927A1 patent drawing
  • US20240272927A1 patent drawing

AI summary

A method for resource allocation for applications and/or application containers in a distributed system of heterogeneous compute nodes, which are heterogeneous at least with respect to their hardware platforms and/or operating systems. The method includes: executing one of the applications and/or the application containers based on an intermediate instruction set architecture by means of a runtime environment, wherein the runtime environment is provided on at least one of the compute nodes; carrying out resource monitoring of resource usage at the compute node by means of the runtime environment, wherein the resource monitoring is carried out based on the intermediate instruction set architecture; carrying out resource allocation based on the resource monitoring that has been carried out.