Memory Filtering Circuit to Cut Data Transfer Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The bottleneck phenomenon in memory devices occurs due to the increased data traffic and latency, especially during filtering operations, which are currently performed in central processing units, leading to degraded performance and higher power consumption.
Innovation Solution
Incorporation of a filtering circuit within the memory device to perform filtering operations directly on data, reducing the need for data transfer between the memory device and the central processing unit, thereby offloading the filtering burden from the CPU.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If filtering operations are performed in the central processing unit, then the filtering processing can be completed, but the data transfer time increases and the system performance is degraded due to bottleneck phenomenon
Solution Approach 1:
The patent merges the filtering circuit into the memory device, combining previously separate functions (memory storage and filtering processing) into a single integrated system. This eliminates the need for data to be transferred between external storage and CPU for filtering operations, thereby reducing data transfer time and resolving the bottleneck phenomenon.
Solution Approach 2:
The filtering circuit acts as an intermediary component within the memory device that processes data before it leaves the memory system. This intermediary filtering capability allows data to be filtered in-place without requiring full transfer to the CPU, reducing unnecessary data movement and improving overall system productivity.
2Productivity
If filtering operations are performed in the central processing unit, then the filtering can be executed, but the power consumption increases
Solution Approach 1:
By merging the filtering function into the memory device's filtering circuit, the patent enables filtering operations to be performed closer to the data source. This reduces the energy required for data transfer and processing in the CPU, as filtering is executed in a lower-power environment within the memory device itself.
Solution Approach 2:
The patent extracts the filtering function from the CPU and relocates it to a dedicated filtering circuit within the memory device. This separation allows the CPU to focus on higher-level processing tasks while the filtering circuit handles data filtering, reducing overall system power consumption by performing filtering operations in a more energy-efficient location.
3Productivity
If data is transferred from external storage device to memory device and then to CPU for filtering, then the filtering operation can be performed, but the latency increases
Solution Approach 1:
The filtering circuit performs filtering operations on data while it is still residing in the memory device, before the data needs to be transferred to the CPU. This preliminary filtering action reduces the volume of data that requires subsequent transfer and processing, thereby reducing overall latency and improving system responsiveness.
Data Source
AI summary
A memory device includes a plurality of memory circuits, and a filtering circuit. The filtering circuit is configured to perform a filtering operation on data and to transmit filtered data to the plurality of memory circuits or to outside of the memory device.