Spiking Neuron Network Plasticity for Visual Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing artificial spiking neural networks face challenges in reliably identifying salient features within a wide variety of inputs due to inefficient computational processes, particularly in real-time visual processing, which exceeds the capabilities of portable devices.

Innovation Solution

The implementation of adaptive plasticity mechanisms in spiking neuron networks, where the efficacy of inhibitory connections is dynamically adjusted based on intra-similarity and inter-similarity measures between neuron responses, enhancing the network's ability to selectively respond to salient features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If spiking neuron networks process visual input in real-time, then processing speed is improved, but computational complexity exceeds portable device capabilities

Engineering Contradiction:
Improveprocessing speedVSAvoidcomputational complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent implements dynamic adjustment of connection efficacy between neurons based on spike timing patterns. The system continuously adapts the strength of inhibitory and excitatory connections during real-time processing, allowing the network to optimize its computational operations on-the-fly. This dynamic plasticity enables the network to handle complex visual processing tasks at speeds suitable for portable devices by adapting its computational complexity requirements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The spiking neuron network performs self-adjustment through activity-dependent plasticity rules. The network automatically modifies its own connection weights based on observed spike timing patterns without external intervention. This self-service mechanism reduces the need for complex external control systems and manual tuning, thereby lowering overall device complexity while maintaining high processing speed for visual tasks.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If connection efficacy is dynamically adjusted based on spike timing, then accuracy in identifying salient features is improved, but computational requirements increase

Engineering Contradiction:
ImproveaccuracyVSAvoidcomputational energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic evaluation of spike timing patterns to adjust connection efficacy. Rather than continuous adjustment, the system evaluates and updates connections at discrete time intervals based on accumulated spike timing information. This periodic action reduces the computational energy required compared to continuous adjustment, while still achieving high accuracy in identifying salient visual features through accumulated temporal patterns.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system changes the efficacy parameter of connections based on observed spike timing patterns. By modifying connection weights as a function of temporal patterns, the network achieves accurate feature identification without requiring proportional increases in computational energy. The parameter adjustment is driven by biological plausibility and efficiency, allowing accurate processing with constrained energy resources suitable for portable devices.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If inhibitory connections are strengthened between similar feature-responsive neurons, then selectivity for salient features is improved, but network complexity increases

Engineering Contradiction:
ImproveselectivityVSAvoidnetwork complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by differentiating the treatment of connections based on the similarity of feature responsiveness. Inhibitory connections between neurons responding to similar features are strengthened, while connections between neurons responding to different features are weakened or left unchanged. This localized adjustment of connection properties enhances selectivity for salient features without requiring uniform complexity changes across the entire network, thereby managing overall network complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS8972315B2Apparatus and methods for activity-based plasticity in a spiking neuron network
Publication Date: 2015.03.03 BRAIN CORP
  • US8972315B2 patent drawing
  • US8972315B2 patent drawing
  • US8972315B2 patent drawing

AI summary

Apparatus and methods for plasticity in spiking neuron network. The network may comprise feature-specific units capable of responding to different objects (red and green color). Plasticity mechanism may be configured based on difference between two similarity measures related to activity of different unit types obtained during network training. One similarity measure may be based on activity of units of the same type (red). Another similarity measure may be based on activity of units of one type (red) and another type (green). Similarity measures may comprise a cross-correlogram and/or mutual information determined over an activity window. Several similarity estimates, corresponding to different unit-to-unit pairs may be combined. The combination may comprise a weighted average. During network operation, the activity based plasticity mechanism may be used to potentiate connections between units of the same type (red-red). The plasticity mechanism may be used to depress connections between units of different types (red-green).