Differential Correlator Filter for On-Chip SPAD Histogram Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional algorithms for processing histograms from single-photon avalanche diode (SPAD) arrays in time-of-flight imagers are computationally intensive, leading to high complexity, power consumption, and memory requirements, which limits integration and increases processing latency.

Innovation Solution

A differential correlator filter is implemented, comprising specific filter regions with varying coefficients to efficiently process histograms, allowing for on-chip processing and reducing computational complexity by using a finite-impulse response (FIR) filter or circular summing multiplication to perform convolution operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional algorithms are used to process histograms from SPAD arrays, then target information can be extracted, but computational complexity and processing time increase significantly

Engineering Contradiction:
Improvetarget information extraction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The histogram processing is segmented into distinct operational phases: accumulation phase where photon events are counted in histogram bins, and processing phase where the differential correlator filter extracts target information. This segmentation allows the computationally intensive filtering to be applied only to accumulated data rather than raw events, reducing overall complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The differential correlator filter is designed with pre-computed coefficients that are prepared in advance based on the expected light source pulse shape. These coefficients are stored and directly applied during histogram processing, eliminating the need for real-time complex calculations and enabling efficient on-chip implementation.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If conventional histogram processing algorithms are used, then accurate target detection is achieved, but memory requirements and power consumption increase

Engineering Contradiction:
Improvetarget detection accuracyVSAvoidmemory requirements
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The essential processing functionality is extracted from complex off-chip algorithms and implemented as a compact differential correlator filter structure directly on the imaging chip. This extraction eliminates the need for large external memory and processing units, reducing both memory requirements and power consumption while maintaining detection accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The filter coefficients are parameterized based on the light source pulse characteristics (such as full width at half maximum). By changing these parameters to match different operating conditions, the same hardware structure can adapt to various scenarios without requiring additional memory or complex reconfiguration.

Inventive Principle:
Principle #35Parameter changes

3Power

If off-chip processing is used for histogram analysis, then computational power is sufficient, but integration level decreases and processing latency increases

Engineering Contradiction:
Improveprocessing powerVSAvoidintegration level
Core Design Contradiction:
PowerVSDevice complexity

Solution Approach 1:

The differential correlator filter is merged with the SPAD array and timing control logic into a single integrated on-chip system. This combining of detection, timing, and processing functions onto one chip eliminates the need for separate off-chip processing units, reducing processing latency and improving integration while maintaining sufficient processing power through the optimized filter architecture.

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If complex processing algorithms are implemented, then processing accuracy is maintained, but processing speed decreases

Engineering Contradiction:
Improvehistogram processing accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The mechanical/computational processing system is replaced with an optimized mathematical approach using differential correlation. Instead of implementing complex iterative algorithms, the solution uses a closed-form filter operation with pre-computed coefficients, dramatically increasing processing speed while preserving the accuracy of target information extraction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The differential correlator filter simplifies histogram processing, enabling efficient extraction of target information with reduced device complexity, latency, and memory requirements, allowing for direct integration into time-of-flight imagers and improved performance in low photon count scenarios.

Implementation Method 1

A reflected photon may generate a carrier in the SPAD through the photo electric effect

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 2

The photon-generated carrier may trigger an avalanche current in one or more of the SPADs in an SPAD array

Methodology Applied
Scientific EffectAvalanche current: Avalanche Breakdown

Data Source

PatentUS12135374B2Differential correlator filter for efficient ToF peak finding
Publication Date: 2024.11.05 STMICROELECTRONICS (RES & DEV) LTD
  • US12135374B2 patent drawing
  • US12135374B2 patent drawing
  • US12135374B2 patent drawing

AI summary

A differential correlator filter includes: a pre-pulse region, where first filter coefficients in the pre-pulse region have negative values; and a pulse region including: a rising edge region adjacent to the pre-pulse region, where second filter coefficients in the rising edge region have positive values; an accumulation region adjacent to the rising edge region, where third filter coefficients of the accumulation region have positive values; and a falling edge region adjacent to the accumulation region, where fourth filter coefficients of the falling edge region have positive values, where the accumulation region is between the rising edge region and the falling edge region. The differential correlator filter further includes a post-pulse region adjacent to the pulse region, where the pulse region is between the pre-pulse region and the post-pulse region, where fifth filter coefficients of the post-pulse region have negative values.