HDR Pixel Stream Mixing for High Contrast Image Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional digital photography systems are limited by the dynamic range of image sensors, which can result in inadequate capture of scenes with high contrast, leading to suboptimal image quality.
Innovation Solution
A system and method for generating high dynamic range (HDR) images by receiving a pixel stream with multiple exposures per pixel from an image sensor, identifying attributes of each exposure, and performing HDR mixing to create a single HDR pixel stream that combines the attributes, thereby expanding the dynamic range of captured images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple exposures are captured to expand dynamic range, then image quality is improved, but processing complexity increases
Solution Approach 1:
The patent performs HDR mixing operations in the pixel stream immediately after image capture, before the data reaches higher-level processing stages. This preliminary action consolidates the dynamic range expansion work early in the pipeline, preventing subsequent processing complexity from accumulating while still achieving improved image quality through multi-exposure merging.
Solution Approach 2:
The patent introduces an intermediate processing stage that operates on pixel streams between capture and final image generation. This intermediary layer handles the complex HDR mixing operations separately from both the capture hardware and the final rendering pipeline, isolating complexity to a dedicated processing stage while maintaining overall system efficiency.
2Loss of information
If HDR mixing is performed on pixel streams, then dynamic range is expanded, but computational load increases
Solution Approach 1:
The patent segments the HDR processing into distinct stages: capturing multiple exposures, merging them into an HDR pixel stream, and then using that stream for final rendering. By dividing the computational task into manageable segments performed at different pipeline stages, the system expands dynamic range effectively while distributing computational load across time rather than concentrating it all at once.
Solution Approach 2:
The patent maintains continuous processing of pixel streams through the HDR mixing stage, ensuring that data flows continuously from capture through processing to output. This continuous action prevents idle computational resources while efficiently utilizing processing power throughout the pipeline, expanding dynamic range without creating unnecessary computational bottlenecks.
Data Source
AI summary
A system, method, and computer program product are provided for performing high dynamic range mixing on a pixel stream. In use, a pixel stream including at least two exposures per pixel from a plurality of pixels of an image sensor is received. A first pixel attribute of a first exposure of the pixel is identified, and a second pixel attribute of a second exposure of the pixel is identified. A first high dynamic range (HDR) pixel is generated by performing HDR mixing on the first exposure of the pixel and the second exposure of the pixel, based on the first pixel attribute, and the second pixel attribute. Additionally, an HDR pixel stream is generated comprising at least the first HDR pixel, and the HDR pixel stream is outputted.