Image Sensor Pixel Grouping for Real-Time HDR Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current High Dynamic Range (HDR) image processing methods require an extended period to capture and compose images with different exposures, limiting real-time image quality and dynamic environment adaptability.
Innovation Solution
An electronic device with an image sensor and processor configuration that allows for real-time processing of long and short exposure pixels, automatically switching between auto-exposure and HDR modes to correct over-exposed and under-exposed regions, using a combination of long and short exposure times to generate high-quality HDR images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If images are captured multiple times with different exposure times to create HDR images, then the dynamic range is expanded and image quality is improved, but the capture time is extended and real-time processing is limited
Solution Approach 1:
The image sensor array is divided into multiple pixel groups, where each group captures images with different exposure times simultaneously. This segmentation allows parallel capture of multiple exposure frames without extending total capture time, resolving the contradiction between image quality and capture time.
Solution Approach 2:
The patent implements dynamic exposure time adjustment where the controller dynamically assigns different exposure times to different pixel groups based on scene requirements. This dynamic approach enables real-time HDR capture by continuously adapting exposure parameters across pixel groups, maintaining both high image quality and real-time performance.
2Adaptability or versatility
If multiple images are captured and composed to create HDR images, then the dynamic range is expanded, but the processing complexity and time required increase
Solution Approach 1:
By segmenting the sensor into pixel groups that simultaneously capture different exposure frames, the system reduces processing complexity. Each pixel group independently processes its exposure data, and the controller combines results without requiring complex temporal alignment, thus expanding dynamic range while managing processing complexity.
Solution Approach 2:
The patent performs preliminary exposure capture across multiple pixel groups simultaneously rather than sequentially composing images over time. This preliminary parallel action reduces the complexity of temporal image registration and composition, enabling real-time HDR processing while maintaining expanded dynamic range.
3Manufacturing precision
If the exposure time is extended to capture more light, then the image quality in dark regions is improved, but the bright regions become over-exposed
Solution Approach 1:
Different pixel groups are assigned different exposure times based on local scene requirements. Pixels in dark regions use longer exposure times to capture sufficient light, while pixels in bright regions use shorter exposure times to avoid over-exposure. This local quality approach resolves the contradiction between improving dark region quality and preventing bright region over-exposure.
Solution Approach 2:
The sensor array is segmented into multiple pixel groups, each capturing images with different exposure times simultaneously. This segmentation allows the system to capture both under-exposed and over-exposed regions in parallel, then combine the data to produce a final image with balanced exposure across all regions, resolving the contradiction between dark region quality and bright region over-exposure.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the creation of high-quality HDR images in real-time, improving dynamic range and adaptability to varying lighting conditions by dynamically adjusting exposure times and processing techniques.
Implementation Method 1
an image sensor configured to acquire image data from an array of pixels included in the image sensor
Data Source
AI summary
An electronic device and a method of controlling an operation thereof are provided. The method includes acquiring image data using an image sensor comprising a first plurality of pixels configured to have a first identical exposure time and a second plurality of pixels configured to have a second identical exposure time, wherein the acquiring of the image data includes acquiring the image data using the first plurality of pixels and the second plurality of pixels while the first plurality of pixels have the first identical exposure time that is identical to the second identical exposure time of the second plurality of pixels and controlling the image sensor such that the first plurality of pixels has the first identical exposure time different from the second identical exposure time of the second plurality of pixels, at least partially based on the acquired image data.