PWM Pixel Sensor Architecture for High Dynamic Range Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
CMOS image sensors face challenges in capturing high dynamic range images due to finite full-well capacity, motion artifacts, and limited dynamic range, especially in low or high light conditions, and struggle with pixel saturation and image quality when objects move relative to the sensor.
Innovation Solution
A pulse-width modulation (PWM) image sensor with a charge-to-time converter (CTC) and time-to-digital converter (TDC) architecture, where the CTC accumulates electrons and triggers a write signal when a threshold is reached, allowing for flexible control of the TDC transfer function and auto-exposure adjustments to extend dynamic range and reduce motion blur.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If a CMOS image sensor uses a fixed full-well capacity per pixel, then the pixel structure remains simple and manufacturing is easier, but the dynamic range is limited and cannot capture both dark and bright areas simultaneously
Solution Approach 1:
The patent transitions from a single-pixel 2D array to a 3D stacked architecture where multiple pixel layers are vertically integrated. Each layer captures light at different intensities, effectively adding a vertical dimension to light intensity measurement. This enables simultaneous capture of both dark and bright areas by distributing pixel responses across multiple layers, thereby extending dynamic range without requiring each individual pixel to have variable capacity.
Solution Approach 2:
The image sensor is divided into multiple pixel layers, each with its own photodiode and readout circuitry. The pixel array is segmented across vertical stacks, where different layers can be optimized for different light intensity ranges. This segmentation allows the system to capture a broader dynamic range by combining responses from multiple specialized layers rather than relying on a single pixel type.
2Illumination intensity
If a CMOS image sensor uses a longer exposure time to capture more light, then low-light performance improves, but motion artifacts and blur increase
Solution Approach 1:
The patent employs periodic scanning of pixel rows combined with a rolling shutter mechanism that sequentially activates different pixel layers at different times. This periodic activation allows the system to capture light over extended effective exposure times while maintaining temporal resolution. By staggering the exposure timing across multiple layers and scanning them sequentially, the system achieves high sensitivity without requiring any single layer to be exposed for a prolonged duration, thereby reducing motion blur.
Solution Approach 2:
The sensor implements dynamic control of pixel activation and readout timing through a rolling shutter mechanism. Different pixel layers can be activated and read out at different times, allowing the system to adapt exposure timing to scene conditions. This dynamic approach enables the sensor to capture sufficient light for low-light conditions while minimizing the effective exposure time for any given scene, thereby reducing motion artifacts.
3Measurement precision
If a CMOS image sensor increases pixel density, then the sensor captures more detail, but the full-well capacity per pixel decreases, limiting dynamic range
Solution Approach 1:
The patent resolves this contradiction by moving from a single-layer 2D pixel array to a multi-layer 3D stacked architecture. High pixel density is achieved in the horizontal plane while additional vertical layers provide increased light storage capacity. The full-well capacity is effectively distributed across multiple layers, so each pixel maintains high spatial resolution while the stack as a whole captures a broader dynamic range by summing electrons across layers.
Solution Approach 2:
The patent implements a nested structure where multiple pixel layers are vertically integrated within a compact footprint. Each layer contains complete pixel functionality (photodiode, transfer gate, floating diffusion, readout circuitry), and layers are nested one above another. This nesting allows the system to pack high pixel density horizontally while utilizing vertical space for additional light storage capacity, effectively combining high resolution with extended dynamic range.
4Reliability
If a CMOS image sensor uses a rolling shutter to reduce motion blur, then temporal resolution improves, but the detection time increases and productivity decreases
Solution Approach 1:
The patent segments the pixel array into multiple independently scannable rows and layers. Instead of scanning the entire array sequentially in a single rolling shutter pass, the system can scan different rows or layers in parallel or use overlapping scan patterns. This segmentation of the scanning process reduces the effective scan time per frame, allowing the system to maintain motion artifact reduction benefits while increasing frame rate.
Solution Approach 2:
The patent implements preliminary charge transfer and accumulation in floating diffusion nodes before the actual readout process. Electrons are transferred from photodiodes to floating diffusions during the exposure period, and this preliminary action prepares the signal for rapid sequential readout. By pre-positioning charges in ready-to-read locations, the system reduces the time required for the rolling shutter scan, thereby improving frame rate without sacrificing motion artifact reduction.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The PWM image sensor achieves high dynamic range imaging, reduces motion blur, and increases pixel density, enabling high-quality image capture across varying light conditions without pixel saturation, by controlling exposure settings and dynamic range through non-linear counter operations.
Implementation Method 1
receiving a number of photons at a PWM pixel of the PWM image sensor, converting the number of photons into a photocurrent as the number of photons is received
Data Source
AI summary
A pulse-width modulation (PWM) image sensor is described herein. The PWM image sensor may have a stacked configuration. A top wafer of the PWM image sensor may have a charge-to-time converter and a logic wafer, stacked with the top wafer, may include a time-to-digital converter. The PWM image sensor may utilize variable transfer functions to avoid highlight compression and may utilize non-linear time quantization. A threshold voltage, as input to a charge-to-time converter, may additionally be controlled to affect light detection, dynamic range, and other features associated with the PWM image sensor.


