Simplifying Spiking Neural Network Models via Temporal Filters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing neural network models face challenges in balancing accuracy and efficiency, with detailed models being complex and resource-intensive, while simplified models lack the realism of biological systems, making it difficult to bridge the gap between detailed and point-neuron network models.

Innovation Solution

The method involves simplifying neural network models by replacing spatially-extended neurons with spatially-constrained neurons and approximating arborized projections with temporal filters, allowing for the derivation of point-neuron networks that retain biophysical characteristics, enabling automated and quantitatively verifiable simplification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If detailed morphologically detailed models are used, then accuracy and biological realism are improved, but computational complexity and resource requirements increase

Engineering Contradiction:
ImproveaccuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the detailed morphological model into a simplified point-neuron model by changing key parameters: replacing spatially-extended neurons with spatially-constrained point neurons, and substituting arborized projections with temporal filters. This parameter transformation maintains accuracy in capturing input-conveyance characteristics while dramatically reducing computational complexity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent creates a simplified copy of the detailed neural network model that preserves essential functional characteristics. The point-neuron network model copies the input-conveyance behavior of the detailed model through temporal filters, providing a computationally efficient representation that accurately reflects the original system's dynamics without requiring exhaustive anatomical detail.

Inventive Principle:
Principle #26Copying

2Productivity

If simplified point-neuron models are used, then computational efficiency is improved, but biological realism and accuracy deteriorate

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidaccuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces temporal filters as a new parameter that captures the essential input-conveyance characteristics of arborized projections. By parameterizing the filter properties based on the detailed model's anatomy and physiology, the simplified model achieves both computational efficiency and accuracy in representing biological neural network behavior.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If detailed anatomical and physiological information is retained, then model accuracy is improved, but ease of operation and computational resources required worsen

Engineering Contradiction:
Improvemodel accuracyVSAvoidease of computation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent extracts only the essential input-conveyance characteristics from the detailed morphological model, separating them from unnecessary anatomical details. By extracting the functional properties of arborized projections and representing them as temporal filters in the point-neuron model, the system achieves accurate computation without the burden of exhaustive detail.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20240370713A1Simplification of spiking neural network models
Publication Date: 2024.11.07 ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)
  • US20240370713A1 patent drawing
  • US20240370713A1 patent drawing
  • US20240370713A1 patent drawing

AI summary

The simplification of neural network models is described. For example, a method for simplifying a neural network model includes providing the neural network model to be simplified, defining a first temporal filter for the conveyance of input from a neuron to an other spatially-extended neuron along the arborized projection, defining a second temporal filter for the conveyance of input from yet another neuron to the spatially-extended neuron along the arborized projection, replacing, in the neural network model, the first, spatially-extended neuron with a first, spatially-constrained neuron and the arborized projection with a first connection extending between the first, spatially-constrained neuron and the second neuron, wherein the first connection filters input from the second neuron in accordance with the first temporal filter and a second connection extending between the first spatially-constrained neuron and the third neuron.