HDR RAW Image Synthesis for Full-Resolution Preview and Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing HDR image processing technologies struggle to simultaneously support previewing, photographing, and video-recording due to issues such as reduced resolution and low signal-to-noise ratio, making them unsuitable for these functions.
Innovation Solution
An electronic device employs an image sensor with a first operation mode that alternates between long and short exposure durations to generate RAW image packets, which are then unpacked and synthesized to create HDR RAW images, subsequently converted to YUV format for high dynamic range processing, enabling high-resolution and high-signal-to-noise ratio images suitable for previewing, photographing, and video-recording.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If HDR image processing is performed using related technologies, then dynamic range and image details are improved, but resolution and signal-to-noise ratio are reduced
Solution Approach 1:
The patent segments the HDR image processing into two distinct paths: one for preview/display that accepts reduced resolution, and another for photographing/video-recording that maintains full resolution by operating on separate RAW images. This segmentation allows each function to have optimized image quality characteristics.
Solution Approach 2:
The patent performs preliminary action by capturing multiple RAW images with different exposure durations before HDR synthesis. These original RAW images are preserved and can be used directly for high-quality photographing and video-recording, while HDR synthesis is performed separately for preview purposes.
2Illumination intensity
If HDR image processing is performed using related technologies, then dynamic range and image details are improved, but the images are unsuitable for simultaneous previewing, photographing and video-recording
Solution Approach 1:
The patent implements multi-functionality by enabling the system to serve multiple purposes simultaneously: the RAW image packet provides HDR preview capability, while the original RAW images within the packet remain available for high-quality photographing and video-recording. This universal approach allows a single image capture mechanism to support diverse functions with appropriate image quality for each.
Solution Approach 2:
The patent segments the image processing workflow into distinct functional paths: preview uses synthesized HDR images, while photographing and video-recording use original RAW images. This segmentation resolves the conflict by allowing each function to use the most appropriate image source for its requirements.
3Illumination intensity
If multiple RAW images with different exposure durations are captured and synthesized, then HDR effect is achieved, but processing complexity increases
Solution Approach 1:
The patent extracts and utilizes the exposure duration metadata from the RAW image packet to identify and separate images with different exposure durations. This extraction approach simplifies the synthesis process by automatically identifying which images to combine, reducing manual intervention and processing complexity.
Solution Approach 2:
The patent changes the exposure duration parameter across multiple captured images to create the HDR effect. By systematically varying this parameter and then synthesizing the results, the system achieves HDR while maintaining a relatively simple processing pipeline that leverages automatic parameter variation rather than complex manual adjustments.
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
A method for image-processing and an electronic device are disclosed. The method includes: obtaining a RAW image packet comprising at least two RAW images, the at least two RAW images having different exposure durations; unpacking the RAW image packet and obtaining the at least two of RAW images; obtaining a High Dynamic Range (HDR) RAW image by performing an image synthesis operation on the at least two RAW images; and performing a previewing, photographing, or video-recording operation on the HDR RAW image.