Image Sensor Merged and Color-Block Modes for HDR Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing methods either result in poor resolution or require excessive time and resources to obtain a High Dynamic Range (HDR) image, making them inconvenient for users.
Innovation Solution
An image processing method that controls an image sensor to output merged and color-block images with different brightness levels, using scaling and interpolation algorithms to convert these images into HDR images, thereby reducing processing time and improving efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional image processing methods are used to obtain HDR images, then the image quality can be improved, but the processing time and resource consumption increase significantly
Solution Approach 1:
The patent segments the image processing task into two distinct modes: merged image mode (combining multiple photosensitive pixels into one output pixel for high brightness and low noise) and color-block image mode (using individual pixels for high resolution). This segmentation allows the system to process different parts of the image differently, achieving HDR quality without requiring extensive processing of the entire image in a single mode.
Solution Approach 2:
The patent implements dynamic switching between merged image mode and color-block image mode based on the specific processing requirements. The system can adaptively select which mode to use for different regions or different processing stages, optimizing the balance between processing speed and image quality in real-time rather than being locked into a single static processing approach.
2Reliability
If merged image mode is used, then the signal-to-noise ratio improves, but the resolution decreases
Solution Approach 1:
The patent merges multiple photosensitive pixels into a single output pixel in the merged image mode, which combines their signals to improve the signal-to-noise ratio. This merging is particularly effective for capturing bright regions and low-light areas with reduced noise, while the system retains the ability to switch to color-block mode when high resolution is needed.
Solution Approach 2:
The patent applies different processing qualities to different parts of the image by allowing selective use of merged or color-block modes for different regions. This enables the system to apply high noise-reduction processing (merged mode) to certain areas while maintaining high resolution (color-block mode) in other areas, optimizing overall image quality without uniformly sacrificing resolution.
3Measurement precision
If color-block image mode is used, then the resolution is maintained, but the processing complexity increases
Solution Approach 1:
The system dynamically adjusts the processing complexity by switching between merged and color-block modes based on the current processing needs. When high resolution is required, the system activates color-block mode with its detailed pixel-level processing; when processing speed or noise reduction is prioritized, it switches to merged mode, thereby adaptively controlling processing complexity rather than maintaining high complexity continuously.
4Loss of information
If HDR image processing is performed using traditional methods, then comprehensive image data is obtained, but the resource consumption becomes excessive
Solution Approach 1:
The patent segments the HDR processing into two complementary modes that can be selectively applied. The merged mode processes images with reduced computational requirements while maintaining good quality for certain regions, and the color-block mode processes specific areas requiring detailed analysis. This segmentation of the processing task reduces overall resource consumption compared to applying full HDR processing uniformly across the entire image.
Solution Approach 2:
The patent changes the processing parameters by switching between merged and color-block modes, which fundamentally alters how the image data is handled. This parameter change allows the system to adjust computational intensity based on requirements, consuming fewer resources when using merged mode while still obtaining comprehensive image data when needed by switching to color-block mode for specific processing objectives.
Data Source
AI summary
An image processing method is provided. The image processing method is applied in the electronic device. The image sensor is controlled to output the merged image and the color-block image. The merged image is converted into the image having the first brightness using the scaling algorithm. The color-block image is converted into the image having the second brightness using the interpolation algorithm, in which the first brightness is greater than the second brightness. The image having the first brightness and the image having the second brightness are merged to obtain a HDR image. An image processing apparatus and an electronic device are also provided.