In-Memory Computation Operator With Adaptive Reference Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computation operators in memory with fixed reference signals for sense amplifiers lead to inefficient conversion times and excessive power loss due to varying signal sizes and network scales in neural networks.
Innovation Solution
A computation operator in memory that includes a word line calculator, a decision-maker, and a sense amplifier, where the decision-maker generates adaptive reference signals based on the number of enabled word lines and used memory size to set a dynamic digital conversion range for the sense amplifier, optimizing conversion efficiency and reducing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a sense amplifier with a fixed reference signal is used to convert readout signals, then the conversion process is simple and reliable, but conversion time is wasted and excessive power loss occurs when signal sizes vary
Solution Approach 1:
The reference signal is changed from fixed to dynamic/adaptive. The sense amplifier now uses an adaptive reference signal that automatically adjusts according to the actual readout signal characteristics (such as signal magnitude and distribution range), enabling the conversion process to match the actual data requirements and avoid unnecessary power consumption while maintaining reliability
Solution Approach 2:
The reference signal parameter is made variable rather than constant. By changing the reference signal parameter adaptively based on input signal characteristics and memory configuration, the system optimizes the conversion process to reduce power loss while maintaining accurate conversion across different operating conditions
2Device complexity
If a sense amplifier with a fixed reference signal is used to convert readout signals, then the circuit design is simple, but conversion time is wasted when signal sizes vary
Solution Approach 1:
The reference signal adjustment mechanism is implemented dynamically based on detected signal characteristics. The system automatically adapts the reference signal level according to the actual readout signal distribution, reducing conversion time for varying signal sizes without requiring complex manual reconfiguration or overly complicated circuit architecture
Solution Approach 2:
The sense amplifier system performs self-adjustment of the reference signal based on the characteristics of the readout signal it receives. This self-service capability allows the system to optimize its own conversion process automatically, reducing conversion time without adding significant external control complexity
3Stability of the object's composition
If the digital conversion range of the sense amplifier is not adjusted according to memory size and enabled word lines, then the sense amplifier operates consistently, but computation speed decreases and power consumption increases
Solution Approach 1:
The digital conversion range parameter of the sense amplifier is made adjustable based on memory configuration. By changing the conversion range according to the number of enabled word lines and used memory size, the system achieves both consistent operation within the valid range and optimized computation speed for different memory configurations
Solution Approach 2:
The sense amplifier is designed to handle multiple different memory configurations and signal sizes through adaptive reference signal adjustment. This multi-functionality allows the same hardware to efficiently process various input sizes and memory configurations without sacrificing operational consistency or requiring multiple dedicated circuits
Data Source
AI summary
A computation operator in memory and an operation method thereof are provided. The computation operator in memory includes a word line calculator, a decision-maker and a sense amplifier. The word line calculator calculates a number of enabled word lines of a memory. The decision-maker generates a plurality of reference signals according to at least one of the number of enabled word lines and a used size of the memory, the reference signals are configured to set a distribution range. The sense amplifier receives a readout signal of the memory, and obtains a computation result by converting the readout signal according to the reference signals.