PWM Pixel Sensor Architecture for High Dynamic Range Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

CMOS image sensors face challenges in capturing high dynamic range images due to finite full-well capacity, motion artifacts, and limited dynamic range, especially in low or high light conditions, and struggle with pixel saturation and image quality when objects move relative to the sensor.

Innovation Solution

A pulse-width modulation (PWM) image sensor with a charge-to-time converter (CTC) and time-to-digital converter (TDC) architecture, where the CTC accumulates electrons and triggers a write signal when a threshold is reached, allowing for flexible control of the TDC transfer function and auto-exposure adjustments to extend dynamic range and reduce motion blur.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a CMOS image sensor uses a fixed full-well capacity per pixel, then the pixel structure remains simple and manufacturing is easier, but the dynamic range is limited and cannot capture both dark and bright areas simultaneously

Engineering Contradiction:
Improvedynamic rangeVSAvoidpixel structure complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent transitions from a single-pixel 2D array to a 3D stacked architecture where multiple pixel layers are vertically integrated. Each layer captures light at different intensities, effectively adding a vertical dimension to light intensity measurement. This enables simultaneous capture of both dark and bright areas by distributing pixel responses across multiple layers, thereby extending dynamic range without requiring each individual pixel to have variable capacity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The image sensor is divided into multiple pixel layers, each with its own photodiode and readout circuitry. The pixel array is segmented across vertical stacks, where different layers can be optimized for different light intensity ranges. This segmentation allows the system to capture a broader dynamic range by combining responses from multiple specialized layers rather than relying on a single pixel type.

Inventive Principle:
Principle #1Segmentation

2Illumination intensity

If a CMOS image sensor uses a longer exposure time to capture more light, then low-light performance improves, but motion artifacts and blur increase

Engineering Contradiction:
Improvelow-light sensitivityVSAvoidimage sharpness
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The patent employs periodic scanning of pixel rows combined with a rolling shutter mechanism that sequentially activates different pixel layers at different times. This periodic activation allows the system to capture light over extended effective exposure times while maintaining temporal resolution. By staggering the exposure timing across multiple layers and scanning them sequentially, the system achieves high sensitivity without requiring any single layer to be exposed for a prolonged duration, thereby reducing motion blur.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The sensor implements dynamic control of pixel activation and readout timing through a rolling shutter mechanism. Different pixel layers can be activated and read out at different times, allowing the system to adapt exposure timing to scene conditions. This dynamic approach enables the sensor to capture sufficient light for low-light conditions while minimizing the effective exposure time for any given scene, thereby reducing motion artifacts.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If a CMOS image sensor increases pixel density, then the sensor captures more detail, but the full-well capacity per pixel decreases, limiting dynamic range

Engineering Contradiction:
Improvespatial resolutionVSAvoiddynamic range
Core Design Contradiction:
Measurement precisionVSIllumination intensity

Solution Approach 1:

The patent resolves this contradiction by moving from a single-layer 2D pixel array to a multi-layer 3D stacked architecture. High pixel density is achieved in the horizontal plane while additional vertical layers provide increased light storage capacity. The full-well capacity is effectively distributed across multiple layers, so each pixel maintains high spatial resolution while the stack as a whole captures a broader dynamic range by summing electrons across layers.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements a nested structure where multiple pixel layers are vertically integrated within a compact footprint. Each layer contains complete pixel functionality (photodiode, transfer gate, floating diffusion, readout circuitry), and layers are nested one above another. This nesting allows the system to pack high pixel density horizontally while utilizing vertical space for additional light storage capacity, effectively combining high resolution with extended dynamic range.

Inventive Principle:
Principle #7Nested doll (Nesting)

4Reliability

If a CMOS image sensor uses a rolling shutter to reduce motion blur, then temporal resolution improves, but the detection time increases and productivity decreases

Engineering Contradiction:
Improvemotion artifact reductionVSAvoidframe rate
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the pixel array into multiple independently scannable rows and layers. Instead of scanning the entire array sequentially in a single rolling shutter pass, the system can scan different rows or layers in parallel or use overlapping scan patterns. This segmentation of the scanning process reduces the effective scan time per frame, allowing the system to maintain motion artifact reduction benefits while increasing frame rate.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary charge transfer and accumulation in floating diffusion nodes before the actual readout process. Electrons are transferred from photodiodes to floating diffusions during the exposure period, and this preliminary action prepares the signal for rapid sequential readout. By pre-positioning charges in ready-to-read locations, the system reduces the time required for the rolling shutter scan, thereby improving frame rate without sacrificing motion artifact reduction.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The PWM image sensor achieves high dynamic range imaging, reduces motion blur, and increases pixel density, enabling high-quality image capture across varying light conditions without pixel saturation, by controlling exposure settings and dynamic range through non-linear counter operations.

Implementation Method 1

receiving a number of photons at a PWM pixel of the PWM image sensor, converting the number of photons into a photocurrent as the number of photons is received

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS12192644B2Pulse-width modulation pixel sensor
Publication Date: 2025.01.07 APPLE INC
  • US12192644B2 patent drawing
  • US12192644B2 patent drawing
  • US12192644B2 patent drawing

AI summary

A pulse-width modulation (PWM) image sensor is described herein. The PWM image sensor may have a stacked configuration. A top wafer of the PWM image sensor may have a charge-to-time converter and a logic wafer, stacked with the top wafer, may include a time-to-digital converter. The PWM image sensor may utilize variable transfer functions to avoid highlight compression and may utilize non-linear time quantization. A threshold voltage, as input to a charge-to-time converter, may additionally be controlled to affect light detection, dynamic range, and other features associated with the PWM image sensor.