Non-volatile Memory Cell Analog Weighting Near-Memory Computation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The demand for efficient computation hardware in AI systems is hindered by the high bandwidth and power consumption required for accessing large amounts of data, particularly in neural networks where data is often retrieved from external memory.
Innovation Solution
A non-volatile memory cell with a storage transistor that receives analog data voltages and outputs analog weighting voltages, allowing for direct computation by processing elements in a near-memory computation system, reducing the computational burden and memory access time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored in external memory and retrieved to internal memory for computation, then data storage capacity is improved, but bandwidth consumption and power consumption increase
Solution Approach 1:
The patent merges memory and computation functions by implementing computation nodes that include both non-volatile memory cells and processing elements within the same integrated structure. This allows data to be stored and processed in-place without requiring retrieval to separate internal memory, thereby reducing access bandwidth and power consumption while maintaining large storage capacity.
2Measurement precision
If data is retrieved from external memory to internal memory for processing, then computation accuracy is improved, but memory access time increases
Solution Approach 1:
The patent implements preliminary action by pre-positioning data in non-volatile memory cells that are directly coupled to processing elements. This eliminates the need for intermediate retrieval steps to internal memory, allowing computation to proceed directly on stored data and significantly reducing access time while preserving computation accuracy through the direct coupling architecture.
3Productivity
If analog data voltages are used for computation in non-volatile memory cells, then computation efficiency is improved, but device complexity increases
Solution Approach 1:
The patent applies universality by designing non-volatile memory cells with storage transistors that serve dual functions: traditional data storage and direct analog computation. The same memory cell structure and transistor components are used for both storing data and performing computational operations on that data, eliminating the need for separate dedicated computation hardware and thereby improving efficiency without proportionally increasing device complexity.
Data Source
AI summary
A non-volatile memory cell includes a storage transistor having a first terminal, a second terminal, and a gate terminal. During a program operation, the first terminal of the storage transistor receives a data voltage according to a weighting to be stored in the non-volatile memory cell, the second terminal of the storage transistor is floating, and the gate terminal of the storage transistor is coupled to a program voltage. The program voltage is greater than the data voltage.