Memristor Neuron Circuit Non-Linear Output Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital circuit blocks used in neuron circuits are complex, consume significant space and power, and are incapable of generating non-linear outputs, limiting their efficiency in neural processing.

Innovation Solution

Incorporating a memristor that applies neuron functions to weighted inputs, generating non-linear voltage outputs, which replaces complex digital circuit blocks and reduces area and power consumption, especially when used in neural networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If digital circuit blocks are used in neuron circuits, then the circuits can perform neural processing, but the area and power consumption increase significantly

Engineering Contradiction:
Improveneural processing capabilityVSAvoidcircuit area
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent replaces digital circuit blocks with an analog neuron circuit that uses a memristor to perform neural processing. The memristor's continuous resistance values directly represent weights, eliminating the need for digital multiplication and addition circuits. This substitution of digital mechanics with analog physics achieves exponential area reduction while maintaining neural processing capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the parameter representation from discrete digital values to continuous analog resistance values in the memristor. By using the memristor's resistance state to directly encode weight parameters, the system eliminates the need for complex digital circuitry that would otherwise be required to store and process these parameters, thereby reducing area consumption.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If digital circuit blocks are used in neuron circuits, then the circuits can perform neural processing, but the power consumption increases significantly

Engineering Contradiction:
Improveneural processing capabilityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by stationary object

Solution Approach 1:

The patent replaces power-hungry digital circuit blocks with a low-power analog neuron circuit. The memristor performs weight multiplication through passive Ohmic conduction, eliminating the need for active digital logic operations that consume significant power. This substitution reduces power consumption exponentially while maintaining neural processing functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If digital circuit blocks are used in neuron circuits, then the circuits can perform linear operations, but they are incapable of generating non-linear outputs

Engineering Contradiction:
Improveoutput function capabilityVSAvoidcircuit complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the weight storage function and the non-linear activation function into a single memristor component. The memristor's resistance represents the weight, and its non-linear current-voltage characteristics provide the activation function. This merging eliminates the need for separate digital circuit blocks that would be required to implement linear operations and activation functions independently, thereby enabling non-linear outputs without increasing complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent changes the operational mode from linear digital arithmetic to non-linear analog conduction. By utilizing the memristor's inherent non-linear electrical characteristics, the circuit naturally generates non-linear outputs without requiring additional complex circuitry, thus improving adaptability while maintaining simplicity.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The use of memristors in neuron circuits results in exponential area and power savings, enabling efficient non-linear output generation and improving neural network performance.

Implementation Method 1

a memristor that applies neuron functions to weighted inputs by generating a non-linear voltage output for the neuron circuit

Methodology Applied
Scientific EffectMemristor non-linear voltage generation:

Data Source

PatentUS10089574B2Neuron circuits
Publication Date: 2018.10.02 HEWLETT PACKARD ENTERPRISE DEV LP
  • US10089574B2 patent drawing
  • US10089574B2 patent drawing
  • US10089574B2 patent drawing

AI summary

Examples disclosed herein relate to neuron circuits and methods for generating neuron circuit outputs. In some of the disclosed examples, a neuron circuit includes a memristor and first and second current mirrors. The first current mirror may source a first current through the memristor and the second current mirror may sink a second current through the memristor. The memristor may generate a voltage output as a function of the sourced first current and the sunk second current through the memristor.