Pre-ISP Image Fusion for Ghost-Free HDR Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The issue of ghosting in images caused by time intervals between multiple exposures during the fusion of images captured with different exposure settings in electronic devices, particularly in high dynamic range (HDR) image processing, is not effectively addressed by existing technologies.
Innovation Solution
An image processing method that applies a gain to an original image, denoises the resulting image, and then fuses it with the original image to produce a high dynamic range image without requiring multiple exposures, using a Pre-Image Signal Processor (Pre-ISP) to enhance brightness and reduce noise.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple exposures are used to achieve high dynamic range, then image quality is improved, but ghosting occurs due to time intervals between exposures
Solution Approach 1:
The patent extracts the harmful time interval factor from the multi-exposure process by using a single exposure with extended exposure time. This eliminates the sequential exposure steps that cause ghosting while maintaining the ability to capture high dynamic range scenes through a single continuous exposure event.
Solution Approach 2:
The patent applies preliminary action by pre-adjusting the exposure time to be sufficiently long before the actual image capture. This preliminary extension of exposure time allows the sensor to capture both bright and dark regions in a single exposure, eliminating the need for subsequent multi-exposure processing that would cause ghosting.
2Manufacturing precision
If HDR sensor function is used to generate multiple images through multiple exposures, then high dynamic range is achieved, but device complexity increases
Solution Approach 1:
The patent merges the functionality of multiple exposures into a single exposure event. By extending the exposure time sufficiently, the system combines what would traditionally require multiple separate exposures into one unified capture operation, thereby achieving high dynamic range without the complexity of multi-exposure processing.
Solution Approach 2:
The patent makes the single exposure process universal by designing it to handle both bright and dark regions simultaneously through extended exposure time. This single exposure operation performs the function that would traditionally require multiple specialized exposure steps, simplifying the overall device architecture.
3Manufacturing precision
If multiple exposures are used to form HDR image, then image quality is improved, but processing time increases
Solution Approach 1:
The patent extracts the time-consuming multi-exposure sequence by replacing it with a single extended exposure. This eliminates the sequential time required for multiple exposures and their subsequent processing, achieving high dynamic range images faster.
Solution Approach 2:
The patent skips the intermediate steps of multiple exposures by using a single extended exposure approach. This rushes through the image capture process in one operation, eliminating the time delays associated with sequential exposure and processing steps.
Data Source
AI summary
Provided are an image processing method, an electronic device, and a storage medium. In the method, an original image is obtained by means of an image sensor. A gain is applied to the original image by means of a Pre-ISP to obtain a first image. The first image is denoised by the Pre-ISP, to obtain a second image. The original image and the second image are fused by the Pre-ISP, to obtain a fused image.