DRAM Neuron Processing Circuits for In-Memory Computing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing approach to executing data-intensive applications using CPUs and GPUs is unsustainable due to high energy consumption and limited performance, primarily because of the processor-memory bottleneck, which is exacerbated by the need for extensive data movement between the processor and memory.

Innovation Solution

A system and method for computing in memory using artificial neurons, where a neuron processing element is integrated into a DRAM architecture, allowing computations to be performed directly within the memory without interfering with the DRAM array or its access protocol, utilizing configurable processing circuits and multiplexers to enable flexible and efficient computation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data-intensive applications are executed using CPUs and GPUs, then computational capability is provided, but energy consumption increases and performance is limited due to processor-memory bottleneck

Engineering Contradiction:
Improvecomputational capabilityVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent merges processing functionality directly into the memory device by integrating neuron processing elements with DRAM cells. The processing circuits are embedded within the memory structure, allowing computations to occur in-place without requiring separate CPU/GPU processors. This integration eliminates the processor-memory bottleneck and dramatically reduces energy consumption by eliminating the need for extensive data movement between processor and memory.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The memory device performs self-computation through the integrated neuron processing elements. The DRAM cells with embedded processing circuits can execute computational operations autonomously using data stored within the memory array itself, without requiring external processor intervention. This self-service capability enables in-memory computing that reduces dependency on external processing units and their associated energy consumption.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If data movement between processor and memory is performed, then data access is enabled, but energy consumption increases by three orders of magnitude

Engineering Contradiction:
Improvedata accessVSAvoidenergy consumption
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The patent extracts the processing functionality from the traditional CPU/GPU and embeds it directly within the memory structure. By taking out the computational tasks from external processors and placing them inside the memory cells themselves, the system eliminates the need for high-energy data movement while maintaining data access capability. The processing circuits operate directly on data stored in the memory array.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The integrated processing circuits act as intermediaries between data storage and computational operations. Rather than requiring data to be moved from memory to processor and back, the processing circuits serve as an intermediary layer within memory that can perform computations directly on stored data, reducing the energy-intensive data movement steps.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of energy

If processing circuits are integrated into DRAM architecture, then data movement is reduced, but device complexity increases

Engineering Contradiction:
Improveenergy efficiencyVSAvoiddevice complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The processing element is segmented into discrete functional components including weight storage circuits, threshold logic circuits, and output circuits that can be independently designed and integrated into the DRAM architecture. This segmentation allows for modular integration of processing functionality without requiring complete redesign of the entire memory system, thereby managing complexity through structured decomposition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processing circuits are designed to perform multiple computational functions using the same basic architectural blocks. The neuron processing elements can execute various operations by configuring the weight storage and threshold logic circuits, allowing a single integrated structure to serve multiple processing purposes. This multi-functionality reduces the need for separate dedicated circuits for different operations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If computations are performed within DRAM directly, then throughput improves by orders of magnitude, but interference with DRAM array or access protocol may occur

Engineering Contradiction:
ImprovethroughputVSAvoidDRAM structure integrity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The processing circuits are nested within the DRAM cell structure, with weight storage circuits and threshold logic circuits embedded inside or adjacent to the memory cells. This nested arrangement allows processing functionality to be contained within the memory array without requiring external interference with the DRAM access protocol. The processing elements utilize the existing DRAM physical structure while maintaining separate computational functionality.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The processing circuits are implemented with local characteristics that are optimized for in-memory computation while maintaining compatibility with the overall DRAM architecture. The weight storage and threshold logic circuits are designed with specific local properties that enable computation without interfering with the global DRAM access protocol. Each processing element maintains local independence that prevents propagation of interference across the memory array.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20260073206A1Computing in memory with artificial neurons
Publication Date: 2026.03.12 THE ARIZONA BOARD OF REGENTS ON BEHALF OF THE UNIV OF ARIZONA
  • US20260073206A1 patent drawing
  • US20260073206A1 patent drawing
  • US20260073206A1 patent drawing

AI summary

A system and method for computing in memory with artificial neurons. According to an embodiment of the present disclosure, there is provided a system, including: a computer-readable memory; a neuron processing element communicatively connected to the computer-readable memory, the neuron processing element including: a plurality of configurable processing circuits each having a plurality of outputs and a plurality of inputs; and a network connecting one or more of the outputs of the configurable processing circuits to one or more of the inputs of the configurable processing circuits, each of the configurable processing circuits including: an artificial neuron having a plurality of inputs; and a register connected to the inputs of the artificial neuron.