In-Pixel Multi-Counter Imaging for Concurrent HDR Signal Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging arrays, such as CCDs and CMOS devices, lack the capability for in-pixel data processing and dynamic range expansion, limiting their ability to handle high dynamic range imaging effectively.

Innovation Solution

The integration of multiple counters within each pixel of the imaging array, allowing for independent control and concurrent performance of image-processing functions, including digital down-sampling and infinite dynamic range sensing, enables advanced signal processing and high dynamic range imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional imaging arrays (CCD/CMOS) are used, then the device structure is simple, but the capability for in-pixel data processing and dynamic range expansion is limited

Engineering Contradiction:
Improvein-pixel data processing capabilityVSAvoiddevice structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple functional components (photodetector, multiple independent counters, and readout circuitry) into a single integrated pixel unit. Each pixel contains 2 or more counters that can independently accumulate photon counts simultaneously, enabling in-pixel data processing without requiring external computational resources. This combining approach transforms a traditionally simple imaging array into a sophisticated computational pixel system capable of high dynamic range imaging and multi-thread processing.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If charge accumulates on a single capacitor at each pixel, then the device structure is simple, but the dynamic range is limited

Engineering Contradiction:
Improvedynamic rangeVSAvoidpixel circuitry
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the single charge storage function into multiple independent counters within each pixel. Instead of using one capacitor to store charge, each pixel employs 2 or more counters that independently accumulate photon counts. This segmentation allows each counter to handle a portion of the dynamic range, and their combined output achieves an extended overall dynamic range that exceeds what a single capacitor could provide.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If multiple counters are integrated in each pixel, then infinite dynamic range sensing is enabled, but the device complexity increases

Engineering Contradiction:
Improvedynamic range sensingVSAvoidintegrated circuitry
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent designs the multiple counters within each pixel to serve multiple functions simultaneously. The same counter infrastructure supports both high dynamic range imaging and multi-thread processing operations. Each counter can be independently controlled to perform different image-processing functions concurrently, allowing the system to achieve universal functionality without proportionally increasing complexity. The readout circuitry is also designed to efficiently handle outputs from multiple counters without requiring separate dedicated paths for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If conventional readout methods are used, then the readout circuitry is simple, but the processing speed is limited

Engineering Contradiction:
Improvereadout rateVSAvoidreadout circuitry
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a time-division multiplexed readout scheme where the readout circuitry periodically switches between reading data from different counters within the same pixel. Instead of requiring simultaneous readout paths for all counters (which would greatly increase complexity), the system uses periodic action to sequentially access each counter's output. This approach achieves high effective readout rates by rapidly alternating between counters, making the multi-counter system practical despite the increased functionality.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables efficient handling of high dynamic range images by allowing for simultaneous multi-thread processing and infinite dynamic range sensing, improving the imaging array's ability to capture a wide range of intensities without loss of signal information.

Implementation Method 1

a detector at each pixel that generates a signal in response to incident photons

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11877068B2Advanced computational pixel imagers with multiple in-pixel counters
Publication Date: 2024.01.16 ANDURIL IND INC
  • US11877068B2 patent drawing
  • US11877068B2 patent drawing
  • US11877068B2 patent drawing

AI summary

A computational pixel imaging device can include multiple digitizing counters per pixel that can be used to execute simultaneous signal-processing threads on acquired image data. The imaging device can also include infinite dynamic range sensing and perform signal down-sampling.