DRAM Neuron Processing Circuits for In-Memory Computing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing approach to executing data-intensive applications using CPUs and GPUs is unsustainable due to high energy consumption and limited performance, primarily because of the processor-memory bottleneck, which is exacerbated by the need for extensive data movement between the processor and memory.
Innovation Solution
A system and method for computing in memory using artificial neurons, where a neuron processing element is integrated into a DRAM architecture, allowing computations to be performed directly within the memory without interfering with the DRAM array or its access protocol, utilizing configurable processing circuits and multiplexers to enable flexible and efficient computation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data-intensive applications are executed using CPUs and GPUs, then computational capability is provided, but energy consumption increases and performance is limited due to processor-memory bottleneck
Solution Approach 1:
The patent merges processing functionality directly into the memory device by integrating neuron processing elements with DRAM cells. The processing circuits are embedded within the memory structure, allowing computations to occur in-place without requiring separate CPU/GPU processors. This integration eliminates the processor-memory bottleneck and dramatically reduces energy consumption by eliminating the need for extensive data movement between processor and memory.
Solution Approach 2:
The memory device performs self-computation through the integrated neuron processing elements. The DRAM cells with embedded processing circuits can execute computational operations autonomously using data stored within the memory array itself, without requiring external processor intervention. This self-service capability enables in-memory computing that reduces dependency on external processing units and their associated energy consumption.
2Ease of operation
If data movement between processor and memory is performed, then data access is enabled, but energy consumption increases by three orders of magnitude
Solution Approach 1:
The patent extracts the processing functionality from the traditional CPU/GPU and embeds it directly within the memory structure. By taking out the computational tasks from external processors and placing them inside the memory cells themselves, the system eliminates the need for high-energy data movement while maintaining data access capability. The processing circuits operate directly on data stored in the memory array.
Solution Approach 2:
The integrated processing circuits act as intermediaries between data storage and computational operations. Rather than requiring data to be moved from memory to processor and back, the processing circuits serve as an intermediary layer within memory that can perform computations directly on stored data, reducing the energy-intensive data movement steps.
3Loss of energy
If processing circuits are integrated into DRAM architecture, then data movement is reduced, but device complexity increases
Solution Approach 1:
The processing element is segmented into discrete functional components including weight storage circuits, threshold logic circuits, and output circuits that can be independently designed and integrated into the DRAM architecture. This segmentation allows for modular integration of processing functionality without requiring complete redesign of the entire memory system, thereby managing complexity through structured decomposition.
Solution Approach 2:
The processing circuits are designed to perform multiple computational functions using the same basic architectural blocks. The neuron processing elements can execute various operations by configuring the weight storage and threshold logic circuits, allowing a single integrated structure to serve multiple processing purposes. This multi-functionality reduces the need for separate dedicated circuits for different operations.
4Productivity
If computations are performed within DRAM directly, then throughput improves by orders of magnitude, but interference with DRAM array or access protocol may occur
Solution Approach 1:
The processing circuits are nested within the DRAM cell structure, with weight storage circuits and threshold logic circuits embedded inside or adjacent to the memory cells. This nested arrangement allows processing functionality to be contained within the memory array without requiring external interference with the DRAM access protocol. The processing elements utilize the existing DRAM physical structure while maintaining separate computational functionality.
Solution Approach 2:
The processing circuits are implemented with local characteristics that are optimized for in-memory computation while maintaining compatibility with the overall DRAM architecture. The weight storage and threshold logic circuits are designed with specific local properties that enable computation without interfering with the global DRAM access protocol. Each processing element maintains local independence that prevents propagation of interference across the memory array.
Data Source
AI summary
A system and method for computing in memory with artificial neurons. According to an embodiment of the present disclosure, there is provided a system, including: a computer-readable memory; a neuron processing element communicatively connected to the computer-readable memory, the neuron processing element including: a plurality of configurable processing circuits each having a plurality of outputs and a plurality of inputs; and a network connecting one or more of the outputs of the configurable processing circuits to one or more of the inputs of the configurable processing circuits, each of the configurable processing circuits including: an artificial neuron having a plurality of inputs; and a register connected to the inputs of the artificial neuron.


