PWM Image Sensor Charge-to-Time Conversion for High Dynamic Range

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

CMOS image sensors face challenges in capturing high dynamic range images due to motion artifacts, limited full-well capacity, and difficulties in obtaining a single shot with high contrast areas depicted accurately.

Innovation Solution

A pulse-width modulation (PWM) image sensor method that includes a charge-to-time converter (CTC) and a time-to-digital converter (TDC) stacked in a Z-direction, allowing for flexible control of the TDC transfer function and enabling single-shot high dynamic range imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a traditional CMOS image sensor is used, then the sensor can capture images, but motion artifacts occur and dynamic range is limited due to finite full-well capacity

Engineering Contradiction:
Improveimage qualityVSAvoiddynamic range
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent transforms the traditional charge-to-voltage conversion approach into a charge-to-time conversion approach. The pixel sensor measures the time required to accumulate a threshold number of electrons from incoming photons, creating a time-based representation of light intensity. This parameter transformation enables high dynamic range imaging because the measurement is limited by the detection period rather than pixel saturation, allowing accurate capture of both bright and dark regions in a single shot without motion artifacts.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If the pixel size is reduced to increase pixel density, then more pixels can be packed, but the full-well capacity is further limited

Engineering Contradiction:
Improvepixel densityVSAvoiddynamic range
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The patent transitions from a two-dimensional charge accumulation model (where electrons are stored in a fixed-capacity node) to a one-dimensional time-based measurement model. By measuring the duration required to accumulate a fixed threshold charge rather than measuring the final charge amount, the system effectively adds a time dimension to the measurement process. This allows the dynamic range to be determined by the detection period length rather than the pixel's physical charge storage capacity, enabling high pixel density without sacrificing dynamic range.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Illumination intensity

If a longer detection period is used to capture more light, then low-light performance improves, but motion blur increases

Engineering Contradiction:
Improvelow-light sensitivityVSAvoidmotion blur
Core Design Contradiction:
Illumination intensityVSStability of the object's composition

Solution Approach 1:

The patent implements a periodic detection process where each pixel independently measures the time to accumulate a threshold charge during a defined detection period. The system uses a rolling shutter mechanism that sequentially activates different rows or groups of pixels at different time offsets. This periodic, segmented approach allows the entire scene to be captured with a single effective exposure time, minimizing motion blur while maintaining sufficient light collection for low-light conditions through the time-based measurement approach.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The PWM image sensor achieves reduced pixel size, increased pixel density, and enhanced dynamic range capabilities, minimizing motion blur and allowing for high-quality image capture in various light conditions.

Implementation Method 1

receiving a number of photons at a PWM pixel of the PWM image sensor, converting the number of photons into a photocurrent as the number of photons is received

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS20250126363A1Pulse-width modulation pixel sensor
Publication Date: 2025.04.17 APPLE INC
  • US20250126363A1 patent drawing
  • US20250126363A1 patent drawing
  • US20250126363A1 patent drawing

AI summary

A pulse-width modulation (PWM) image sensor is described herein. The PWM image sensor may have a stacked configuration. A top wafer of the PWM image sensor may have a charge-to-time converter and a logic wafer, stacked with the top wafer, may include a time-to-digital converter. The PWM image sensor may utilize variable transfer functions to avoid highlight compression and may utilize non-linear time quantization. A threshold voltage, as input to a charge-to-time converter, may additionally be controlled to affect light detection, dynamic range, and other features associated with the PWM image sensor.