Spiking Neural Network for Conic Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional hardware architectures struggle to efficiently solve large-scale conic optimization problems in real-time due to high power consumption and inefficiencies in exploiting sparse and modular structures, making them unsuitable for power-constrained and real-time applications.

Innovation Solution

A conic programming system utilizing spiking neural networks with neuromorphic architectures that encode constraint coefficients and decision variables, allowing for timely and energy-efficient solutions to conic optimization problems through sparse communication and fine-grained parallelism.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional hardware architectures are used to solve large-scale conic optimization problems, then computational accuracy can be maintained, but power consumption increases and real-time performance deteriorates

Engineering Contradiction:
Improvecomputational accuracyVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent replaces conventional Von Neumann-based hardware architectures with a spiking neural network architecture that mimics biological neural computation. This substitution enables event-driven, sparse computation that significantly reduces power consumption while maintaining the ability to solve large-scale conic optimization problems. The spiking neural network uses discrete spike events rather than continuous voltage levels, enabling energy-efficient computation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements dynamic, event-driven computation in the spiking neural network where neurons and synapses activate only when spikes occur. This dynamic operation mode allows the system to adapt computation to problem complexity, maintaining accuracy for large-scale problems while consuming power only when computation is actually needed, rather than continuous operation of conventional hardware.

Inventive Principle:
Principle #15Dynamics

2Reliability

If conventional hardware architectures are used to solve large-scale conic optimization problems, then computational accuracy can be maintained, but solution time increases and real-time performance deteriorates

Engineering Contradiction:
Improvecomputational accuracyVSAvoidsolution time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the conic optimization problem into distinct computational components that map to the spiking neural network architecture: constraint coefficients are encoded in the first layer, decision variables in the second layer, and objective function evaluation in the third layer. This segmentation enables parallel processing of different problem components, significantly reducing solution time while maintaining computational accuracy through the distributed nature of the neural network.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the conventional sequential optimization approach into a spatially distributed neural network computation across multiple layers. By encoding constraints, variables, and objectives in different layers of the spiking neural network, the system processes information in parallel across spatial dimensions rather than sequentially, achieving real-time performance for large-scale problems.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If conventional hardware architectures are used, then general-purpose computation can be performed, but efficiency in exploiting sparse and modular structures deteriorates

Engineering Contradiction:
Improvegeneral-purpose computation capabilityVSAvoidcomputation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent implements local quality by allowing different layers of the spiking neural network to specialize in different aspects of the optimization problem. The first layer specializes in constraint representation, the second in variable encoding, and the third in objective evaluation. This local specialization enables efficient exploitation of sparse and modular problem structures while maintaining the ability to handle general conic optimization problems through the overall network architecture.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20230259749A1Conic programming based on neural network with spiking neuromorphic architecture
Publication Date: 2023.08.17 INTEL CORP
  • US20230259749A1 patent drawing
  • US20230259749A1 patent drawing
  • US20230259749A1 patent drawing

AI summary

A neural network, which can solve conic optimization problems may include a first layer, a second layer, and a third layer. The first layer includes first neurons encoding constraint coefficients of the conic optimization problem. The second layer includes second neurons encoding decision variables of the conic optimization problem. The third layer includes an integrator neuron. Data may be sent from a first neuron to a second neuron or from the second neuron to the first neuron. A neuron, after receiving data from another neuron, may update its internal state parameter based on the data and the weight of the connection between the two neurons. The communication may be triggered by the internal state parameter of the neuron sending the data meets a criterion. After the internal state parameter of the integrator neuron meets a criterion, the integrator neuron may output a solution to the conic optimization problem.