Service Mapping Component for Hardware Acceleration Routing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The computing industry faces challenges in integrating software-driven computing devices with hardware acceleration components, such as FPGAs, due to their differing architectures, performance characteristics, and power requirements, making it difficult to effectively utilize their combined processing capabilities.

Innovation Solution

A service mapping component (SMC) is introduced to determine the appropriate component for processing requests, choosing between local software-driven host components, local hardware acceleration components, and remote hardware acceleration components based on factors like line-rate services, latency, power considerations, and security, ensuring optimal resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If hardware acceleration components are integrated to improve processing speed, then processing efficiency is improved, but device complexity increases due to fundamentally different architectures

Engineering Contradiction:
Improveprocessing speedVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

A service mapping component (SMC) is introduced as an intermediary between software-driven host components and hardware acceleration components. The SMC receives service requests, determines the most appropriate component for execution based on request characteristics and component capabilities, and routes requests accordingly. This mediator resolves the architectural dissimilarity by providing a unified interface that abstracts the complexity of coordinating between fundamentally different device types.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The service mapping component provides universal functionality by being capable of routing requests to multiple different types of components (local software components, local hardware acceleration components, and remote hardware acceleration components). This multi-functional approach allows a single component to handle diverse request types and target various execution environments, reducing overall system complexity through consolidation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If hardware acceleration components are used to enhance processing capabilities, then productivity is improved, but ease of operation deteriorates due to different program configuration paradigms

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidease of operation
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The service mapping component operates autonomously to determine the most appropriate execution target for each service request. It self-evaluates request characteristics (such as whether the service corresponds to a line-rate service, latency considerations, power considerations) and automatically selects the optimal component without requiring manual configuration or intervention. This self-service capability simplifies operation by eliminating the need for users to understand or manage the complex configuration paradigms of different hardware components.

Inventive Principle:
Principle #25Self-service

3Loss of time

If local hardware acceleration components are prioritized for service execution, then response time is reduced, but adaptability decreases when hardware resources are unavailable

Engineering Contradiction:
Improveresponse timeVSAvoidadaptability
Core Design Contradiction:
Loss of timeVSAdaptability or versatility

Solution Approach 1:

The service mapping component implements dynamic request routing that adapts to current system conditions. When a service request arrives, the SMC evaluates the availability and state of hardware acceleration components in real-time. If local hardware resources are available and suitable, the request is routed there for fast execution. If hardware resources are unavailable or unsuitable, the SMC dynamically adjusts and routes the request to alternative components (remote hardware or local software). This dynamic behavior maintains both fast response times when possible and system adaptability when conditions change.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11099906B2Handling tenant requests in a system that uses hardware acceleration components
Publication Date: 2021.08.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11099906B2 patent drawing
  • US11099906B2 patent drawing
  • US11099906B2 patent drawing

AI summary

A service mapping component (SMC) is described herein for processing requests by instances of tenant functionality that execute on software-driven host components (or some other components) in a data processing system. The SMC is configured to apply at least one rule to determine whether a service requested by an instance of tenant functionality is to be satisfied by at least one of: a local host component, a local hardware acceleration component which is locally coupled to the local host component, and/or at least one remote hardware acceleration component that is indirectly accessible to the local host component via the local hardware acceleration component. In performing its analysis, the SMC can take into account various factors, such as whether or not the service corresponds to a line-rate service, latency-related considerations, security-related considerations, and so on.