Voltage Tracking Modulator for Multiply-Accumulate Neural Network Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multiplier-accumulator (MAC) devices are inadequate for handling continuous-time binary signals, which are essential in neural networks, as they face challenges with signal corruption and interconnect limitations when using analog or digital signals, leading to complications in distributing accurate voltage or current across multiple layers.

Innovation Solution

The implementation of multiply-accumulate circuitry and voltage tracking modulator circuitry that generates continuous-time binary output signals by varying pulse widths, allowing for efficient buffering and fan-out similar to digital signals, thereby avoiding signal corruption and interconnect limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If analog signals are used in MAC devices, then signal distribution across multiple layers is enabled, but signal corruption occurs and interconnect limitations arise

Engineering Contradiction:
Improvesignal distribution capabilityVSAvoidsignal accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces a voltage tracking modulator as an intermediary device that converts analog accumulation voltages into continuous-time binary output signals. This mediator enables signal distribution while maintaining reliability by translating the analog signal into a more robust binary format that is less susceptible to corruption during transmission across interconnects.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the signal parameter from continuous analog voltage to continuous-time binary signals with variable pulse widths. This parameter transformation allows the signal to maintain adaptability for neural network operations while improving reliability by reducing signal corruption and interconnect limitations associated with traditional analog signals.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If digital signals are used in MAC devices, then signal corruption is reduced, but interconnect complexity increases and bandwidth utilization decreases

Engineering Contradiction:
Improvesignal accuracyVSAvoidinterconnect structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent employs dynamic continuous-time binary signals with variable pulse widths that adapt to the accumulation voltage levels. This dynamic signaling approach maintains the reliability benefits of digital signals while reducing interconnect complexity by eliminating the need for complex digital bus structures and serial schemes, allowing more flexible and efficient signal distribution.

Inventive Principle:
Principle #15Dynamics

3Ease of manufacture

If traditional MAC circuitry is used, then simple circuit design is maintained, but handling of continuous-time binary signals is inadequate

Engineering Contradiction:
Improvecircuit design simplicityVSAvoidsignal type compatibility
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent enhances traditional MAC circuitry by integrating a voltage tracking modulator that enables the circuit to handle continuous-time binary signals in addition to traditional analog signals. This multi-functional approach maintains the simplicity of the original MAC design while adding adaptability to process neural network-specific continuous-time binary signals, thereby resolving the contradiction between design simplicity and signal compatibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10007517B2Multiply-accumulate with voltage tracking modulation
Publication Date: 2018.06.26 HEWLETT PACKARD ENTERPRISE DEV LP
  • US10007517B2 patent drawing
  • US10007517B2 patent drawing
  • US10007517B2 patent drawing

AI summary

An example device may include multiply-accumulate circuitry and voltage-tracking modulator circuitry. The multiply-accumulate circuitry may be to increase and decrease an accumulation voltage held by an accumulator based on a number of input signals. The voltage-tracking modulator circuitry may be to generate an output signal based on the accumulation voltage, wherein the output signal is a continuous-time binary signal that tracks changes of the accumulation voltage by varying pulse widths of the output signal. The example device may be used as a neuron in a neural network.