Accelerator Manager Validation and Deployment via OpenCAPI

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer systems face inefficiencies in performance due to traditional system architectures, where compute power is not optimally positioned relative to data, leading to bottlenecks and suboptimal performance.

Innovation Solution

The Open Coherent Accelerator Processor Interface (OpenCAPI) specification enables processors to attach to coherent accelerators and I/O devices, allowing for a data-centric approach by sharing virtual addresses, and an accelerator manager validates and deploys accelerator images to programmable devices, dynamically generating and deploying hardware accelerators to improve performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional system architecture is used, then system complexity is reduced, but system performance is degraded due to compute power not being positioned closer to data

Engineering Contradiction:
Improvesystem performanceVSAvoidsystem architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system is segmented into distinct components: processors, accelerators, and I/O devices, each with specialized functions. The accelerator manager further segments the validation and deployment processes into separate operations (validation phase, deployment phase), allowing complex tasks to be handled in manageable stages while maintaining overall system performance

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The accelerator manager acts as an intermediary between accelerator developers and the programmable device, handling validation, deployment, and management tasks. This mediator component enables the complex accelerator integration without requiring the end system to directly manage the complexity, thus improving performance while containing complexity in a dedicated management layer

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If accelerator validation and deployment management is implemented, then accelerator reliability is improved, but processing time is increased due to validation steps

Engineering Contradiction:
Improveaccelerator reliabilityVSAvoidvalidation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Validation is performed as a preliminary action before deployment. The accelerator manager validates the accelerator image (checking specifications, format, and requirements) before attempting deployment, preventing failed deployment attempts and ensuring reliability from the start

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The validation process serves as a cushioning mechanism by identifying and addressing potential issues before deployment. By checking accelerator specifications, format compliance, and requirement satisfaction in advance, the system prevents runtime failures and ensures smooth deployment

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

3Measurement precision

If multiple validation methods are used, then accelerator accuracy is improved, but device complexity is increased

Engineering Contradiction:
Improveaccelerator validation accuracyVSAvoidvalidation process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The validation process is segmented into multiple independent checks: specification validation, format validation, and requirement validation. Each validation method focuses on a specific aspect of accelerator correctness, improving overall accuracy while keeping each individual validation step manageable and well-defined

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10817339B2Accelerator validation and reporting
Publication Date: 2020.10.27 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10817339B2 patent drawing
  • US10817339B2 patent drawing
  • US10817339B2 patent drawing

AI summary

An accelerator manager validates an accelerator image using one or more suitable validation methods, which may include comparing results of running an accelerator with results of simulating the accelerator, comparing results of running an accelerator on two different programmable devices, and deploying the accelerator to a cloud of an accelerator provider and running the accelerator to determine whether the accelerator meets defined specifications. The accelerator manager can also report information about one or more accelerators to an accelerator provider and/or to a provider of a programmable device.