Decoding Spiking Reservoirs With Continuous Plasticity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computational models are limited in decoding spiking reservoirs with continuous synaptic plasticity, particularly in distinguishing spiking output neurons and unsupervised discrimination among test patterns, which restricts their application in complex neural systems like autonomous driving.

Innovation Solution

A system that uses a neural network with spiking neurons to compute firing rate codes from output spikes, employing a discriminability index (DI) calculated from separability and uniqueness measures, allowing for unsupervised discrimination and scalable decoding in spiking reservoirs with continuous plasticity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If liquid state machines or echo state networks are used, then rich dynamics of neural systems can be observed, but they are only applicable for firing rate models and cannot handle spiking reservoirs with continuous plasticity

Engineering Contradiction:
Improveapplicability to spiking reservoirsVSAvoiddecoding capability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent changes the parameter representation from continuous firing rates to discrete spike counts within time windows. By transforming the continuous neural output into discrete temporal codes, the system enables reliable decoding of spiking reservoirs while maintaining their dynamic capabilities and continuous plasticity properties.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If continuous synaptic plasticity is implemented in spiking reservoirs, then the system can learn and adapt, but decoding performance deteriorates due to inability to discriminate among spiking output neurons

Engineering Contradiction:
Improvecontinuous synaptic plasticityVSAvoiddiscrimination among test patterns
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the continuous neural output by dividing time into discrete windows and counting spikes within each window. This temporal segmentation transforms the continuous plasticity effects into discrete, measurable patterns that can be discriminated and decoded, thereby maintaining both adaptability and measurement precision.

Inventive Principle:
Principle #1Segmentation

3Extent of automation

If spiking reservoirs with continuous plasticity are used, then unsupervised learning can occur, but the system cannot discriminate among spiking output neurons without human intervention

Engineering Contradiction:
Improveunsupervised learningVSAvoiddiscrimination of test patterns
Core Design Contradiction:
Extent of automationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements self-service by having the system automatically compute discriminability indices and identify unique temporal patterns without human intervention. The decoding mechanism autonomously discriminates among spiking output neurons by analyzing spike count patterns, enabling unsupervised learning while maintaining ease of detection and measurement.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10586150B2System and method for decoding spiking reservoirs with continuous synaptic plasticity
Publication Date: 2020.03.10 HRL LAB
  • US10586150B2 patent drawing
  • US10586150B2 patent drawing
  • US10586150B2 patent drawing

AI summary

Described is a system for decoding spiking reservoirs even when the spiking reservoir has continuous synaptic plasticity. The system uses a set of training patterns to train a neural network having a spiking reservoir comprised of spiking neurons. A test pattern duration d is estimated for a set of test patterns P, and each test pattern is presented to the spiking reservoir for a duration of d/P seconds. Output spikes from the spiking reservoir are generated via readout neurons. The output spikes are measured and the measurements are used to compute firing rate codes, each firing rate code corresponding to a test pattern in the set of test patterns P. The firing rate codes are used to decode performance of the neural network by computing a discriminability index (DI) to discriminate between test patterns in the set of test patterns P.