In-Memory Arithmetic via Sensing Circuitry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing memory devices face inefficiencies in performing arithmetic operations due to the need for data transfer between memory arrays and external processing resources, leading to increased complexity, power consumption, and time requirements, particularly for operations like neural network processing.
Innovation Solution
The implementation of sensing circuitry within the memory array that performs arithmetic and logical operations on bit strings without transferring data via buses, allowing for reduced computations and parallel processing of operations like multiplication directly within the memory array.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is transferred between memory arrays and external processing resources for arithmetic operations, then processing capability is provided, but device complexity and power consumption increase
Solution Approach 1:
The patent merges the memory array with sensing circuitry that performs arithmetic operations directly within the memory structure. The sensing circuitry includes compute components that can execute operations on data stored in the memory array without requiring external processing resources, thereby reducing device complexity while maintaining processing capability.
Solution Approach 2:
The sensing circuitry is designed to perform multiple functions including data sensing and arithmetic operations. This multi-functionality eliminates the need for separate external processing resources, reducing the overall device complexity while providing comprehensive processing capabilities for various computational tasks.
2Adaptability or versatility
If data is transferred between memory arrays and external processing resources, then arithmetic operations can be performed, but power consumption increases
Solution Approach 1:
By combining the arithmetic operation functionality within the memory array itself through integrated sensing circuitry, the patent eliminates repeated data transfers between memory and external processors. This reduces the energy consumption associated with data transfer while maintaining the ability to perform arithmetic operations efficiently.
Solution Approach 2:
The memory array with integrated sensing circuitry performs arithmetic operations autonomously on stored data without requiring continuous external processing support. This self-service capability reduces the overall power consumption by eliminating the need for persistent external power supply and data transfer operations.
3Adaptability or versatility
If data is transferred via buses for arithmetic operations, then processing can occur externally, but time requirements increase
Solution Approach 1:
The patent merges arithmetic operation execution within the memory array by integrating sensing circuitry that can perform computations on stored data. This eliminates the time-consuming data transfer process between memory and external processors, allowing operations to be executed directly where the data resides.
Solution Approach 2:
The sensing circuitry is pre-configured within the memory array to perform arithmetic operations immediately on data without requiring external processing initiation. This preliminary setup eliminates the sequential steps of data transfer followed by external processing, significantly reducing time requirements for arithmetic operations.
Data Source
AI summary
Systems, apparatuses, and methods related to arithmetic operations in memory are described. The arithmetic operations may be performed using bit strings and within a memory array without transferring the bit strings to circuitry external to the memory array. For instance, sensing circuitry that can include a sense amplifier and a compute component can be coupled to a memory array. A controller can be coupled to the sensing circuitry and can be configured to cause one or more bit strings to be transferred from the memory array to the sensing circuitry. In addition to the arithmetic operations, the sensing circuitry can also perform a logical operation using the one or more bit strings.