Analog Neural Memory Drift Compensation Circuitry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Artificial neural networks face challenges in compensating for data drift errors in non-volatile memory cells within vector-by-matrix multiplication arrays, which affects the precision and accuracy of weight values stored in analog neuromorphic memory systems.

Innovation Solution

The implementation of a data drift monitoring circuit and a bitline compensation circuit that generates and injects a compensation current into the bitlines of the array to correct for drift errors during read operations, ensuring precise weight value storage and retrieval.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If data drift is not compensated in non-volatile memory cells, then the system structure remains simple, but the precision and accuracy of weight values deteriorate over time

Engineering Contradiction:
Improveprecision of weight valuesVSAvoidcomplexity of compensation circuitry
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the monitoring circuit continuously tracks data drift in memory cells and dynamically adjusts compensation currents through the bitline compensation circuit. This closed-loop system measures the actual drift and applies real-time corrections, maintaining weight value precision without requiring complete system redesign.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces intermediate compensation circuits (monitoring circuit and bitline compensation circuit) that act as mediators between the memory cells and the read operation. These intermediary components handle the drift correction function, isolating the complexity from the core memory array while preserving measurement precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If compensation current is continuously injected into bitlines, then the accuracy of weight values is maintained, but the energy consumption increases

Engineering Contradiction:
Improveaccuracy of weight valuesVSAvoidenergy consumption of compensation circuit
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The monitoring circuit operates periodically rather than continuously, measuring data drift at intervals and activating compensation only when drift exceeds thresholds. This periodic operation maintains weight value accuracy while significantly reducing energy consumption compared to continuous compensation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The compensation current parameters are dynamically adjusted based on the measured drift level. The system changes compensation magnitude and frequency according to actual conditions, applying minimal necessary correction rather than constant maximum compensation, thereby optimizing energy efficiency while maintaining reliability.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple monitoring and compensation circuits are added to the VMM array, then the data drift compensation capability is improved, but the device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improvedata drift compensation capabilityVSAvoidmanufacturing complexity of compensation circuits
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent segments the compensation function into separate modular circuits: a monitoring circuit for drift detection and a bitline compensation circuit for correction. This segmentation allows independent optimization and manufacturing of each module, reducing overall manufacturing complexity while maintaining comprehensive compensation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The monitoring and compensation circuits are designed to work across multiple bitlines and memory cells simultaneously, providing universal compensation capability. This multi-functionality reduces the number of separate components needed compared to individual cell-level compensation, simplifying manufacturing while improving overall reliability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution effectively compensates for data drift, maintaining the accuracy and precision of weight values in analog neuromorphic memory systems, thereby enhancing the performance and reliability of artificial neural networks.

Implementation Method 1

a data drift monitoring circuit coupled to the array for generating an output indicative of data drift

Methodology Applied
Scientific EffectElectrical property detection:

Implementation Method 2

a bitline compensation circuit for generating a compensation current in response to the output from the data drift monitoring circuit and injecting the compensation current into one or more bitlines of the array

Methodology Applied
Scientific EffectElectrical current injection:

Data Source

PatentUS12056601B2Circuitry to compensate for data drift in analog neural memory in an artificial neural network
Publication Date: 2024.08.06 SILICON STORAGE TECHNOLOGY INC
  • US12056601B2 patent drawing
  • US12056601B2 patent drawing
  • US12056601B2 patent drawing

AI summary

Numerous embodiments are provided for compensating for drift error in non-volatile memory cells within a VMM array in an analog neuromorphic memory system. For example, in one embodiment, a circuit is provided for compensating for drift error during a read operation, the circuit comprising a data drift monitoring circuit coupled to the array for generating an output indicative of data drift; and a bitline compensation circuit for generating a compensation current in response to the output from the data drift monitoring circuit and injecting the compensation current into one or more bitlines of the array.