Host Buffer Prefetching via Internal-Memory Decision Logic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data processing systems require hosts to determine preread data, which occupies resources and affects efficiency in processing reading-writing requests.
Innovation Solution
A data processing system with internal-memory devices and a buffer-prefetching decision generator that transfers the decision-making process from the host to the internal-memory side, allowing pre-buffered data to be directly transmitted to the host's buffer element.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the host determines preread data locally, then the host can control the prefetching process, but the host resource consumption increases and processing efficiency decreases
Solution Approach 1:
The patent extracts the buffer-prefetching decision generator from the host system and relocates it to the internal-memory device. This separation removes the prefetching decision-making function from the host, eliminating the resource consumption and efficiency degradation that would result from host-based prefetching control, while preserving the control capability within the memory subsystem.
Solution Approach 2:
The internal-memory device is equipped with its own buffer-prefetching decision generator, enabling it to autonomously determine which data to prefetch and when. This self-service capability allows the memory device to independently optimize its own data loading without requiring host intervention, thereby improving host processing efficiency while maintaining reliable prefetching control.
2Adaptability or versatility
If the host determines preread data, then the prefetching can be customized, but the host load increases
Solution Approach 1:
The decision-making function is extracted from the host and placed in the internal-memory device. This allows the host to remain lightweight and focused on its primary processing tasks, while the memory device handles the adaptive prefetching decisions locally, reducing host load without sacrificing prefetching customization capability.
Solution Approach 2:
The internal-memory device's built-in buffer-prefetching decision generator enables the memory subsystem to autonomously adapt its prefetching behavior based on access patterns and requirements, eliminating the need for the host to expend resources on determining preread data while maintaining full adaptability.
3Reliability
If the buffer-prefetching decision generator is located at the host, then the host can make prefetching decisions, but the efficiency of processing reading-writing requests decreases
Solution Approach 1:
The buffer-prefetching decision generator is extracted from the host and relocated to the internal-memory device. This architectural change separates the decision-making function from the host's request processing path, allowing the host to focus exclusively on handling reading-writing requests while the memory device independently manages prefetching decisions, thereby improving overall request processing efficiency without losing decision-making capability.
Solution Approach 2:
By equipping the internal-memory device with its own buffer-prefetching decision generator, the system enables the memory subsystem to self-manage its data prefetching operations. This eliminates the overhead of host involvement in prefetching decisions, allowing the host to process reading-writing requests more efficiently while the memory device maintains autonomous control over its buffer management.
Data Source
AI summary
A data processing system and method, and a medium. In the present application, the data processing system includes a plurality of internal-memory devices and at least one host. After the host has received an accessing request, if the host has determined that the buffer element of the host does not store the target data that the accessing request is to access, the current host transmits the accessing request to the plurality of internal-memory devices, whereby the plurality of internal-memory devices respond to the accessing request, determine pre-buffered data by using the buffer-prefetching decision generator, and transmit the pre-buffered data to the buffer element of the current host to be stored.