Time-Multiplexed High Dynamic Range Image Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging technologies capture limited dynamic range, resulting in loss of detail in highlights or shadows, and require expensive hardware configurations like multiple camera heads to achieve high dynamic range imaging.
Innovation Solution
A method for creating time-multiplexed high dynamic range images using a single camera, where images are captured at varying exposure levels and combined in a Bayer color space without converting to intensity space, allowing for efficient memory usage and processing, even with limited hardware resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If multiple camera heads are used to capture images with multiple exposure levels, then high dynamic range imaging capability is improved, but device complexity and cost increase
Solution Approach 1:
The patent applies periodic action by capturing multiple images at different exposure levels in rapid succession using a single camera. The camera alternates between different exposure settings (e.g., short exposure for bright areas, long exposure for dark areas) to periodically sample the scene at varying luminance ranges, then combines these temporally separated images into a single HDR image.
Solution Approach 2:
The patent implements dynamics by making the exposure time variable rather than fixed. The system dynamically adjusts the exposure duration for each captured image based on the desired luminance range, allowing the same camera to capture both bright highlights (short exposure) and dark shadows (long exposure) by changing the exposure parameter between captures.
2Illumination intensity
If multiple images at different exposure levels are captured and combined, then luminance range representation is improved, but memory and processing requirements increase
Solution Approach 1:
The patent extracts only the necessary information from each captured image during the combining process. Rather than storing and processing all pixel data from multiple high-resolution images, the system extracts relevant luminance information from each exposure level and combines only what is needed to construct the final HDR image, reducing memory requirements.
Solution Approach 2:
The patent segments the image processing task by handling different exposure levels separately during capture, then combining them in a structured manner. The combining process is segmented into steps: aligning images, detecting saturation, selecting appropriate pixels from each exposure level, and merging them into the final HDR image, which allows efficient memory management at each stage.
3Productivity
If images are captured and processed in real-time for HDR video, then frame rate is improved, but processing complexity increases
Solution Approach 1:
The patent applies preliminary action by performing alignment and registration of multiple exposure images before the actual HDR combining process. By pre-aligning the images based on detected features or motion estimation, the system prepares the data in advance, which simplifies and accelerates the subsequent combining operation, enabling real-time HDR video processing.
Solution Approach 2:
The patent implements self-service through automated saturation detection and pixel selection algorithms that automatically determine which pixels from which exposure levels should be used in the final HDR image. The system self-adjusts the combining process based on the actual content of each captured image, eliminating the need for manual parameter tuning and enabling real-time operation.
Data Source
AI summary
Technology is described for creating time multiplexed, high dynamic range images. The method can include the operation of obtaining a first image having a base exposure level captured from an image sensor. The first image can be stored in an accumulation memory. Another operation is obtaining a second image having a modified exposure level as compared to the base exposure level. A determination can be made as to whether incoming pixels in the second image exceed a saturation threshold. The pixels of the second image can be combined with the pixels of the first image to form a high dynamic range image in the accumulation memory.