Phase Change Memory Synapse for Spike-Timing Dependent Plasticity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Artificial neural networks lack effective mechanisms to replicate the spike-dependent plasticity observed in biological synapses, which is crucial for learning and memory, as they typically use traditional digital models rather than analog memory elements that can adapt in-place like biological synapses.

Innovation Solution

The implementation of phase change memory (PCM) elements in artificial synapses, controlled by MOS transistors, to create spike-dependent plasticity by applying specific pre-synaptic and post-synaptic pulses that modify the conductance based on the timing of neuronal spikes, mimicking the long-term synaptic weight adaptation mechanism of STDP.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional digital models are used in artificial neural networks, then computational operations can be performed, but the ability to replicate spike-dependent plasticity and adapt in-place like biological synapses is lost

Engineering Contradiction:
Improvespike-dependent plasticityVSAvoidsynaptic adaptation mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces traditional digital computational models with a physical analog system using phase change memory devices. The phase change material's resistance naturally adapts based on the timing and frequency of voltage pulses applied, mimicking biological spike-dependent plasticity without requiring complex digital algorithms. This substitution of mechanical/physical behavior for digital computation enables synaptic adaptation while reducing overall system complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention utilizes changes in the physical parameters of the phase change memory device, specifically its resistance state, to encode synaptic weight. By applying voltage pulses with specific timing and frequency patterns that correspond to pre-synaptic and post-synaptic spikes, the device's resistance changes adaptively, replicating STDP learning rules through physical parameter modification rather than digital computation.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If phase change memory elements are used to replicate biological synapses, then adaptive learning mechanisms can be achieved, but current flow control and energy dissipation become challenges

Engineering Contradiction:
Improvesynaptic weight adaptationVSAvoidenergy dissipation
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent employs periodic voltage pulse sequences applied to the phase change memory device to simulate neuronal spiking activity. By using pulsed rather than continuous signaling, the system achieves synaptic adaptation only when needed (when spikes occur), reducing energy dissipation during idle periods while maintaining the ability to perform learning operations when biological spikes are detected.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The invention exploits phase transitions in the phase change material (amorphous to crystalline and vice versa) to modify synaptic weight. These phase transitions enable significant resistance changes with relatively low energy input compared to maintaining continuous current flow, allowing adaptive learning while minimizing energy dissipation. The phase change mechanism provides efficient, discrete weight updates rather than continuous analog modulation.

Inventive Principle:
Principle #36Phase transitions

3Ease of operation

If continuous current flow is used in artificial synapses, then operational simplicity is maintained, but energy dissipation increases significantly

Engineering Contradiction:
Improvecontinuous operationVSAvoidenergy dissipation
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The system replaces continuous current flow with periodic voltage pulses that mimic the discrete spiking behavior of biological neurons. Current flows only during pulse application moments rather than continuously, dramatically reducing energy dissipation while maintaining operational capability. The pulsed operation naturally aligns with the event-driven nature of neural computation, where synaptic updates occur only in response to detected spikes.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the creation of electronic synapses that can adaptively change conductance in response to spike timing, effectively replicating the learning and memory mechanisms of biological synapses, thereby enhancing the computational efficiency and reducing energy dissipation by restricting current flow to only when necessary.

Implementation Method 1

a phase change memory element; after the pre-synaptic spiking event, applying a first pulse to a pre-synaptic node of a synapse having a phase change memory element

Methodology Applied
Scientific EffectPhase change: Phase Change

Data Source

PatentUS8447714B2System for electronic learning synapse with spike-timing dependent plasticity using phase change memory
Publication Date: 2013.05.21 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US8447714B2 patent drawing
  • US8447714B2 patent drawing
  • US8447714B2 patent drawing

AI summary

A system, method and computer program product for producing spike-dependent plasticity in an artificial synapse is disclosed. According to one embodiment, a method for producing spike-dependent plasticity in an artificial neuron comprises generating a pre-synaptic spiking event in a first neuron when a total integrated input to the first neuron exceeds a first predetermined threshold. A post-synaptic spiking event is generated in a second neuron when a total integrated input to the second neuron exceeds a second predetermined threshold. After the pre-synaptic spiking event, a first pulse is applied to a pre-synaptic node of a synapse having a phase change memory element. After the post-synaptic spiking event, a second varying pulse is applied to a post-synaptic node of the synapse, wherein current through the synapse is a function of the state of the second varying pulse at the time of the first pulse.