Neural Network Simulation via Discrete State Transitions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current neuromorphic and synaptronic computation systems lack effective methods to simulate the dynamic behavior of biological neurons, particularly in updating neuronal states based on spike events and state transition information, which is crucial for accurately modeling neural networks.

Innovation Solution

A neural network system comprising a memory device and a controller unit that utilizes a lookup table to maintain and update neuronal states for multiple neurons, integrating incoming spike events and state transition information to manage system states, allowing for precise simulation of neural dynamics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional digital models are used to simulate neurons, then computational simplicity is maintained, but biological fidelity and accuracy of neural dynamics simulation deteriorate

Engineering Contradiction:
Improveaccuracy of neural dynamics simulationVSAvoidcomplexity of simulation system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the complex neural simulation task into discrete state transitions. Each neuron's continuous dynamics are divided into discrete states (e.g., resting, spiking, refractory) with clearly defined transition conditions. This segmentation allows accurate biological simulation while maintaining computational tractability through discrete event processing rather than continuous differential equations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses parameter changes to represent neuronal state transitions. Instead of simulating continuous membrane potentials, the system changes discrete parameters (state variables) that capture essential neuronal behavior. State transition rules modify these parameters based on spike timing and synaptic inputs, accurately reflecting biological dynamics like STDP while avoiding complex continuous computations.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If detailed state transition information is maintained for all neurons, then simulation accuracy is improved, but memory requirements and computational overhead increase

Engineering Contradiction:
Improveprecision of neuronal state trackingVSAvoidmemory storage requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential state transition information needed for accurate neural simulation. Instead of maintaining complete continuous-state representations, the system extracts discrete state variables and transition rules that capture critical neuronal behavior. This extraction reduces memory requirements while preserving simulation accuracy for key phenomena like spike timing and synaptic plasticity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses lightweight, disposable state representations for each neuron. Each neuron's state is represented by simple discrete variables that are updated incrementally through state transitions. These minimal state representations consume little memory and can be efficiently updated without requiring persistent storage of detailed historical data, enabling scalable simulation of large neural networks.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Loss of time

If continuous neuronal dynamics are simulated in real-time, then temporal accuracy is maintained, but processing speed and energy consumption worsen

Engineering Contradiction:
Improvetemporal precision of spike eventsVSAvoidprocessing speed
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent uses periodic action through event-driven processing. Instead of continuously updating all neurons at fixed time steps, the system processes state transitions periodically at event boundaries (spike arrivals). This event-driven periodic updating maintains temporal precision for spike timing while dramatically reducing processing speed requirements, as computations occur only when state changes are needed rather than continuously.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent maintains continuity of useful action by ensuring that state transitions accurately reflect continuous neuronal dynamics without requiring continuous computation. The discrete state transition model preserves the continuous temporal relationships between spikes and state changes, maintaining biological fidelity while enabling efficient batch processing of state updates rather than continuous numerical integration.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11341401B2Hardware architecture for simulating a neural network of neurons
Publication Date: 2022.05.24 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11341401B2 patent drawing
  • US11341401B2 patent drawing
  • US11341401B2 patent drawing

AI summary

Embodiments of the invention relate to a neural network system for simulating neurons of a neural model. One embodiment comprises a memory device that maintains neuronal states for multiple neurons, a lookup table that maintains state transition information for multiple neuronal states, and a controller unit that manages the memory device. The controller unit updates a neuronal state for each neuron based on incoming spike events targeting said neuron and state transition information corresponding to said neuronal state.