Accelerator Workload Offloading With Dynamic FPGA Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Application developers face high development costs due to the lack of mechanisms for efficiently utilizing accelerators in local and remote environments, as they often do not know the specific hardware configuration provided by hardware vendors or network operators.
Innovation Solution
An accelerator management device that includes a workload management unit and an accelerator management unit to manage correspondence information, allowing for workload offloading to suitable accelerators, and a command device to dynamically allocate FPGA circuits based on workload frequency and demand.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If an accelerator is utilized in a local environment or remote environment, then application operation smoothness is improved, but development cost increases due to lack of mechanism for workload-offlag and hardware configuration awareness
Solution Approach 1:
The patent introduces an accelerator management device as an intermediary between the user terminal and the accelerator. This management device handles the complexity of accelerator configuration, workload-offlag, and hardware awareness, allowing applications to run smoothly without developers needing to directly manage accelerator details. The intermediary absorbs the complexity while providing simple access to accelerators.
Solution Approach 2:
The accelerator management device automatically manages accelerator allocation and workload distribution without requiring manual intervention from developers. The system self-adjusts based on workload requirements and accelerator availability, eliminating the need for developers to manually configure accelerator parameters or understand complex hardware configurations.
2Productivity
If workload is offloaded to accelerator, then calculation efficiency is improved, but device complexity increases due to need for correspondence information management
Solution Approach 1:
The accelerator management device automatically manages the correspondence information between workloads and accelerators without developer intervention. The system autonomously determines which accelerator should handle which workload based on predefined criteria and real-time conditions, eliminating manual management complexity while maintaining high calculation efficiency.
Solution Approach 2:
The system dynamically adjusts correspondence information parameters based on changing workload requirements and accelerator availability. The management device monitors parameters such as workload priority, accelerator capacity, and communication status, then reconfigures the workload-accelerator mappings accordingly, optimizing calculation efficiency while abstracting the complexity from developers.
Data Source
AI summary
A management device of an accelerator management mechanism includes a workload management unit that manages correspondence information that associates each workload with an accelerator of a calculation node that may support the workload, and an accelerator management unit that receives an inquiry about a workload from a user terminal, acquires information of an accelerator of a calculation node that may support the workload of the inquiry with reference to the correspondence information, responds to the user terminal with the acquired information, and thereby offloads the workload of the inquiry from the user terminal to the accelerator of the calculation node for which the response has been made.