Orchestrated Memory Address Rewriting for Virtual Accelerator Data Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods using accelerators like GPUs or FPGAs in virtual environments face inefficiencies in data transfer speed and dynamic data cooperation, leading to slow response times and inadequate function changes.
Innovation Solution
An information processing device with an orchestrator that allocates memory areas for data cooperation between functions and a control unit that rewrites memory addresses to optimize data transfer between virtual environments, enabling efficient data cooperation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data transfer is performed between virtual environments (containers or VMs) to achieve data cooperation between functions, then the system can achieve functional modularity and flexibility, but the data transfer speed is reduced due to overhead of data transfer between virtual environments
Solution Approach 1:
The patent merges the data transfer path by allowing functions in different virtual environments to directly access shared memory areas without going through the virtual environment data transfer interface. The orchestrator allocates shared memory areas that can be directly accessed by multiple functions, eliminating the overhead of virtual environment data transfer while maintaining functional modularity.
Solution Approach 2:
The patent introduces an orchestrator as an intermediary that manages shared memory area allocation and provides address rewriting functionality. The orchestrator acts as a mediator between the virtual environments and the shared memory, translating access requests and managing memory allocation without requiring data to physically transfer between virtual environment boundaries.
2Productivity
If conventional data transfer methods between virtual environments are used, then the system structure is simple, but the system cannot dynamically switch data cooperation between functions and thus cannot quickly respond to function change requests
Solution Approach 1:
The patent implements dynamic address rewriting capability in the control unit, which can rewrite memory addresses in real-time based on orchestrator instructions. This allows the system to dynamically switch data cooperation paths between functions without physical reconfiguration, enabling quick response to function change requests while maintaining a relatively simple hardware structure.
Solution Approach 2:
The orchestrator performs preliminary allocation of shared memory areas and pre-configures address rewriting rules before function changes occur. When function changes are requested, the system can quickly switch to pre-configured memory paths, reducing the response time for function changes without requiring complex runtime reconfiguration mechanisms.
Data Source
AI summary
One aspect of the present invention is an information processing device including a function achieved by software executed in a virtual environment to which virtual hardware resources including an accelerator are allocated and an orchestrator, in which: the orchestrator allocates a transfer source memory area and a transfer destination memory area for cooperation target data between the functions; and the function includes a control unit that rewrites an address of the transfer source memory area or transfer destination memory area which is referred to when a function of an own virtual environment performs data cooperation with a function of another virtual environment to an address of the transfer source memory area or transfer destination memory area allocated by the orchestrator.