PIM Device Information Gatherer for Data Bottleneck Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data bottlenecks occur frequently in semiconductor memory devices due to the separation of memory and processor functions, leading to inefficiencies in data transmission and processing for applications like neural networks and IoT, which require extensive computational operations.
Innovation Solution
A Processing-in-Memory (PIM) device is introduced, combining memory functions with processor operations, featuring a memory and an information gatherer that processes data and generates information, allowing for efficient data and information transfer through multiple paths, reducing the need for repeated data access and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If memory functions and processor functions are separated, then device functionality is modular and manageable, but data bottlenecks occur due to frequent data transmission between memory and processor
Solution Approach 1:
The patent combines memory functions and processor functions into a single integrated device. The PIM device includes a memory unit for storing data and an information gatherer (processor unit) for executing computational operations on the stored data, eliminating the need for separate memory and processor components and reducing data transmission bottlenecks.
Solution Approach 2:
The PIM device performs multiple functions within a single integrated structure. It can simultaneously store data in memory, process data through the information gatherer, and return both data and processed information to external processors, making it a multi-functional component that replaces separate memory and processor units.
2Ease of operation
If data is transmitted between memory and external processor, then data access is straightforward, but execution time and energy consumption increase due to repeated data access
Solution Approach 1:
The information gatherer within the PIM device performs preliminary computational operations on data while it is stored in memory. By executing instructions and generating information directly within the memory device before external access, the system reduces the need for repeated data transmission and processing cycles, thereby decreasing execution time.
Solution Approach 2:
The information gatherer acts as an intermediary between the stored data and external processors. It processes data internally and returns only the necessary processed information to external processors, reducing the volume of data that needs to be transmitted and processed externally, thus reducing execution time and energy consumption.
3Device complexity
If data is transmitted between memory and external processor, then data storage and processing are separated, but energy consumption increases due to data transmission
Solution Approach 1:
By merging memory and processor functions into the PIM device, the patent eliminates the need for data transmission between separate components. The information gatherer processes data directly where it is stored, removing the energy-consuming data transmission step while maintaining functional integration.
Solution Approach 2:
The PIM device performs data processing internally using its integrated information gatherer. Instead of relying on external processors to handle all computational operations, the device serves itself by executing instructions and generating information within its own structure, thereby eliminating energy-consuming external data transmission and processing cycles.
Data Source
AI summary
A processing in memory (PIM) device includes a memory configured to receive data through a first path from a host processor provided outside the PIM device, and an information gatherer configured to receive the data through a second path connected to the first path when the data is transferred to the memory via the first path, and to generate information by processing the data received through the second path.