Recurrent Neural Network Decoding for Time-Encoded Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional synchronous analog-to-digital conversion becomes challenging as power supply voltages decrease, making it difficult to process analog signals effectively in low power environments, particularly in applications like nano-sensors and neuroscience modeling, where time encoding machines (TEMs) encode signals in the time domain rather than the amplitude domain.

Innovation Solution

The use of recurrent neural networks to reconstruct TEM-encoded signals by formulating the reconstruction as a variational problem and solving for coefficients through optimization, which can be implemented in systems with adders, integrators, and piecewise linear activators defined by specific differential equations, allowing for efficient decoding of signals encoded by Time Encoding Machines (TEMs) and Video Time Encoding Machines (vTEMs).

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional synchronous sampling is used to capture analog signals, then digital representation can be achieved, but processing becomes difficult as power supply voltage decreases

Engineering Contradiction:
Improvesignal capture accuracyVSAvoidprocessing difficulty
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces traditional synchronous sampling mechanisms with Time Encoding Machines that operate asynchronously. Instead of using clock-synchronized amplitude sampling, the system encodes analog signals into time-domain representations using event-driven encoding, eliminating the need for high-precision synchronous sampling circuits that fail at low voltages

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention changes the encoding parameter from amplitude domain to time domain. By encoding signal information in temporal intervals rather than voltage levels, the system avoids the fundamental limitation where reduced supply voltage directly degrades sampling accuracy, as time interval measurements remain accurate even when voltage levels are low

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If power supply voltage is reduced for low power consumption, then energy efficiency improves, but traditional synchronous sampling becomes more difficult

Engineering Contradiction:
Improvepower consumptionVSAvoidsampling reliability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent substitutes voltage-level sampling with time-interval measurement. The Time Encoding Machine uses asynchronous event detection that relies on timing rather than voltage threshold crossing, allowing reliable operation at low supply voltages where traditional comparators and samplers fail

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses the signal's own transitions to trigger encoding events without requiring external clock synchronization or high-voltage reference levels. The encoding process is self-regulating based on signal dynamics, enabling reliable operation across wide voltage ranges including low-power regimes

Inventive Principle:
Principle #25Self-service

3Measurement precision

If A/D converter resolution is increased to maintain accuracy at lower voltages, then signal representation improves, but each bit represents lower voltage increment making conversion more difficult

Engineering Contradiction:
Improvesignal representation accuracyVSAvoidconverter complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the multi-bit voltage quantization process with a time-interval encoding process. Instead of using multiple voltage thresholds and complex comparator logic, the system encodes signal amplitude information in the duration between encoding events, achieving high precision without requiring high-resolution voltage comparators

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention transforms the problem from one dimension (voltage amplitude quantization) to another dimension (time interval measurement). By mapping amplitude information to temporal domain, the system achieves equivalent or superior precision using timing measurements rather than voltage level discrimination, simplifying the converter architecture

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS8874496B2Encoding and decoding machine with recurrent neural networks
Publication Date: 2014.10.28 THE TRUSTEES OF COLUMBIA UNIV IN THE CITY OF NEW YORK
  • US8874496B2 patent drawing
  • US8874496B2 patent drawing
  • US8874496B2 patent drawing

AI summary

Techniques for reconstructing a signal encoded with a time encoding machine (TEM) using a recurrent neural network including receiving a TEM-encoded signal, processing the TEM-encoded signal, and reconstructing the TEM-encoded signal with a recurrent neural network.