Dynamic Reference Frame Selection for Image Noise Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cameras on mobile electronic devices often capture images with ghost artifacts and limited sharpness due to limited dynamic range, especially in dynamic scenes with high saturation, as they struggle to effectively blend multiple image frames with different exposures.
Innovation Solution
A system and method for dynamically selecting a reference image frame by generating short and long reference image frames based on the amount of saturated motion and shadow regions, allowing for the selection of either frame to minimize noise and artifacts, and generating a final image using the selected reference frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If multiple image frames with different exposures are captured and blended, then dynamic range is improved, but ghost artifacts and limited sharpness occur in dynamic scenes with high saturation
Solution Approach 1:
The system dynamically selects between short and long exposure reference frames based on real-time scene conditions (shadow regions and saturated motion areas). This dynamic adaptation allows the blending process to adjust to changing scene characteristics, resolving the contradiction between capturing high dynamic range and maintaining image sharpness in dynamic scenes.
Solution Approach 2:
The patent applies different reference frame selections to different regions of the image. Short exposure frames are used in saturated motion areas to avoid ghosting, while long exposure frames are used in shadow regions to improve brightness. This local quality approach allows simultaneous optimization of different image regions for their specific requirements.
2Illumination intensity
If long exposure frames are used, then shadow regions are improved, but saturated motion areas produce ghost artifacts
Solution Approach 1:
The system assigns different reference frame types to different spatial regions based on their characteristics. Long exposure frames serve as references for shadow regions to enhance brightness, while short exposure frames serve as references for saturated motion areas to eliminate ghosting. This localized reference frame assignment resolves the contradiction between improving shadow brightness and avoiding motion ghosting.
Solution Approach 2:
The system analyzes scene characteristics (shadow regions and saturated motion areas) and uses this feedback to dynamically select appropriate reference frames. This feedback mechanism ensures that the correct reference frame type is chosen for each region, allowing the system to improve shadow brightness without introducing ghost artifacts in motion areas.
3Manufacturing precision
If short exposure frames are used, then saturated motion areas are captured clearly, but shadow regions become underexposed
Solution Approach 1:
The patent implements region-specific reference frame selection where short exposure frames are used for saturated motion areas to maintain clarity, while long exposure frames are used for shadow regions to ensure adequate brightness. This local quality approach allows the system to optimize each region for its specific lighting conditions without compromising overall image quality.
4Speed
If dynamic scene processing is performed, then motion capture is improved, but noise and artifacts increase
Solution Approach 1:
The system dynamically adapts its processing approach based on scene characteristics. By detecting saturated motion areas and shadow regions, the system dynamically selects appropriate reference frames for each region, allowing accurate motion capture in dynamic scenes while minimizing noise and artifacts through region-specific optimization.
Data Source
AI summary
A method includes obtaining, using at least one image sensor of an electronic device, multiple image frames of a scene. The multiple image frames include a plurality of short image frames at a first exposure level and a plurality of long image frames at a second exposure level longer than the first exposure level. The method also includes generating a short reference image frame and a long reference image frame using the multiple image frames. The method further includes selecting, using a processor of the electronic device, the short reference image frame or the long reference image frame as a reference frame, where the selection is based on an amount of saturated motion in the long image frame and an amount of a shadow region in the short image frame. In addition, the method includes generating a final image of the scene using the reference frame.