Accelerator Control Device for Temporary Data Deletion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As data sizes processed by accelerators increase, out-of-core processing becomes common, leading to degraded performance due to the need to evacuate data from the accelerator's memory to a host computer, especially when the I/O bandwidth is limited, which existing techniques do not adequately address.
Innovation Solution
An accelerator control device with decision, determination, and deletion units that analyze processing flow information to identify temporary data, determine when all tasks using this data are completed, and delete it from the accelerator's memory to manage memory usage and prevent performance degradation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data size processed by accelerator increases, then processing capability is improved, but processing performance degrades due to frequent data evacuation
Solution Approach 1:
The system performs preliminary analysis of the processing flow information to identify temporary data before execution. By pre-determining which data are temporary and will not be needed after task completion, the system can proactively delete this data from accelerator memory, preventing memory overflow and reducing the need for frequent data evacuation to host memory.
Solution Approach 2:
The system implements automatic deletion of temporary data from accelerator memory after the tasks that generated or used this data are completed. This discarding mechanism frees up memory space for new data, enabling continuous processing of large datasets without performance degradation from memory pressure.
2Quantity of substance
If data is evacuated from accelerator memory to host memory, then memory capacity is improved, but processing speed decreases due to limited I/O bandwidth
Solution Approach 1:
The system extracts and removes temporary data from accelerator memory after it has served its purpose. By taking out only the unnecessary temporary data rather than evacuating working data to host memory, the system maintains adequate memory capacity while avoiding the performance penalty of I/O operations.
Solution Approach 2:
The accelerator control device autonomously manages memory by automatically identifying, determining, and deleting temporary data without requiring intervention to evacuate data to host memory. This self-service approach maintains memory capacity through intelligent deletion rather than through I/O-bound evacuation operations.
3Duration of action of moving object
If temporary data is retained in accelerator memory, then processing continuity is improved, but memory utilization efficiency decreases
Solution Approach 1:
The system continuously monitors task execution status and provides feedback to the deletion mechanism. By tracking whether tasks are complete and whether data are still needed, the system dynamically adjusts memory content, deleting temporary data only when safe to do so, thus maintaining processing continuity while optimizing memory utilization.
Data Source
AI summary
This accelerator control device includes: a decision unit which, in processing flow information representing a flow by which a task generated according to a program executed by an accelerator processes data, decides, from among the data, temporary data temporarily generated during execution of a program; a determination unit which, on the basis of an execution status of the task by the accelerator and the processing flow information, determines, for every task using the decided data among the temporary data, whether or not execution of the task has been completed; and a deletion unit which deletes the decided data stored in a memory of the accelerator when execution of every task using the decided data has been completed, whereby, degradation, of processing performance by an accelerator, which occurs when a size of data to be processed by the accelerator is large is avoided.