PIM Device Bias Data Feedback for Deterministic Arithmetic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Processing-in-memory (PIM) devices face limitations in performing deterministic arithmetic operations efficiently due to the separation of processors and memory in traditional hardware systems, leading to degraded performance in artificial intelligence applications like deep learning, where increased computational demands and data communication limitations hinder speed and accuracy.
Innovation Solution
A PIM device with an arithmetic circuit and data output unit, including a data selector, latch, delay circuit, and OR gate, enables deterministic arithmetic operations by selectively feeding back bias data and performing logical operations to enhance data processing speed within the device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a general hardware system with separated memory and processor is used, then the system structure is simple and easy to manufacture, but the data communication limitations between memory and processor degrade the performance of artificial intelligence applications
Solution Approach 1:
The patent merges the processor and memory into a single integrated PIM device, where the arithmetic circuit is directly coupled to the memory cell array. This integration eliminates the need for separate data communication channels between processor and memory, thereby removing the communication bottleneck that limited AI application performance in traditional systems.
2Productivity
If the number of layers in neural network is increased to improve AI performance, then the computational demands increase exponentially, but the separated processor-memory architecture limits the data processing speed
Solution Approach 1:
The PIM device performs arithmetic operations directly within the memory structure itself. The arithmetic circuit is integrated with the memory cell array, allowing data to be processed in-place without being transferred to a separate processor. This self-service capability enables the system to handle exponentially increasing computational demands by performing computations where the data resides, thereby maintaining high data processing speed even as neural network complexity increases.
3Ease of operation
If traditional separated processor and memory architecture is used, then the device complexity is low, but the data communication between memory and processor creates performance limitations
Solution Approach 1:
The patent integrates the arithmetic circuit directly with the memory cell array in a unified PIM device structure. The arithmetic circuit includes components such as bit line circuits, word line circuits, and computation units that are physically and functionally coupled to the memory cells, enabling data to be read, processed, and written back without external data movement.
4Speed
If PIM device performs arithmetic operations directly in memory, then the data processing speed is improved, but the device complexity increases due to integration of processor and memory
Solution Approach 1:
The PIM device is segmented into distinct functional units including memory cell arrays, arithmetic circuits, and control logic units. Each segment performs a specific function - the memory cells store data, the arithmetic circuits perform computations on the stored data, and the control logic coordinates operations. This segmentation allows the complex integrated structure to be managed through modular design, where each component can be optimized independently while working together to achieve high data processing speed.
Data Source
AI summary
An arithmetic device includes an arithmetic circuit configured to perform an arithmetic operation to output arithmetic result data and a data output unit configured to feedback bias data to the arithmetic circuit prior to the arithmetic operation.


