Spiking Neural Network Dynamic Reconfiguration for Learning Rules

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing adaptive systems are limited in their ability to dynamically reconfigure and simultaneously implement various learning rules, such as reinforcement, supervised, and unsupervised learning, using the same set of network resources, leading to inefficiencies and increased complexity in handling multiple learning tasks.

Innovation Solution

A spiking network stochastic signal processing system that selects groups of neurons based on task indications and operates them according to different learning rules, using a high-level neuromorphic description language to identify and configure neurons for specific learning tasks, allowing for dynamic reconfiguration and concurrent implementation of multiple learning rules.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If separate controllers are used for different learning tasks, then each task can be implemented with dedicated learning rules, but the device complexity and resource requirements increase

Engineering Contradiction:
Improveability to implement multiple learning rulesVSAvoidnumber of separate controllers
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a single controller that can dynamically reconfigure to perform multiple learning tasks using different learning rules (supervised, unsupervised, reinforcement learning). The controller contains a reconfigurable network of computational units and synaptic connections that can be programmed to implement various learning algorithms, eliminating the need for separate dedicated controllers for each learning task type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The controller employs dynamic reconfiguration mechanisms that allow the network topology, connection weights, and learning rule parameters to be modified in real-time based on the current learning task requirements. This dynamic adaptability enables the same hardware resources to be efficiently reused across different learning paradigms without requiring static dedicated structures.

Inventive Principle:
Principle #15Dynamics

2Reliability

If task-specific learning rules are implemented in separate blocks, then each learning task can be optimized, but the loss of time for reconfiguration and increased device complexity occur

Engineering Contradiction:
Improvetask-specific learning performanceVSAvoidreconfiguration time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The controller pre-loads multiple learning rule configurations and algorithms into its memory and processing units during system initialization or idle periods. When a learning task is assigned, the controller can quickly switch to the appropriate pre-configured learning rule without requiring time-consuming on-the-fly configuration, thus reducing reconfiguration time while maintaining task-specific optimization.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If multiple learning tasks are handled simultaneously with separate controllers, then each task receives dedicated resources, but the productivity and resource efficiency decrease

Engineering Contradiction:
Improveresource utilization efficiencyVSAvoidnumber of controllers
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The single reconfigurable controller serves multiple learning tasks sequentially and concurrently by dynamically allocating its computational resources to different learning rules as needed. This universal design allows the same hardware resources to be shared across multiple learning tasks, improving resource utilization efficiency while maintaining the capability to handle diverse learning requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9015092B2Dynamically reconfigurable stochastic learning apparatus and methods
Publication Date: 2015.04.21 BRAIN CORP
  • US9015092B2 patent drawing
  • US9015092B2 patent drawing
  • US9015092B2 patent drawing

AI summary

Generalized learning rules may be implemented. A framework may be used to enable adaptive signal processing system to flexibly combine different learning rules (supervised, unsupervised, reinforcement learning) with different methods (online or batch learning). The generalized learning framework may employ average performance function as the learning measure thereby enabling modular architecture where learning tasks are separated from control tasks, so that changes in one of the modules do not necessitate changes within the other. Separation of learning tasks from the control tasks implementations may allow dynamic reconfiguration of the learning block in response to a task change or learning method change in real time. The generalized learning apparatus may be capable of implementing several learning rules concurrently based on the desired control application and without requiring users to explicitly identify the required learning rule composition for that application.