HDR Image Composition with Moving Object Displacement Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional high dynamic range (HDR) composition methods for images result in unnatural images when capturing moving objects due to displacement and blur, as they assume accurate extraction of moving object regions without error.
Innovation Solution
An image processing apparatus and method that detects displacement between images, corrects for displacement, detects moving object regions, and composes images using weighted addition of multiple images to replace moving object regions, ensuring natural image generation regardless of object position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If HDR composition processing is applied to moving objects, then dynamic range is improved, but image naturalness deteriorates due to luminance variation
Solution Approach 1:
The patent segments the image into moving object regions and non-moving object regions. Different processing methods are applied to each segment: weighted addition of multiple images is used for moving objects to maintain natural appearance, while traditional HDR composition is used for non-moving objects to maximize dynamic range. This segmentation resolves the contradiction by allowing each region to be processed optimally for its specific characteristics.
Solution Approach 2:
The patent applies different quality characteristics to different regions of the image. Moving object regions receive processing that prioritizes natural appearance and uniform luminance, while non-moving object regions receive processing that prioritizes dynamic range and detail preservation. This local differentiation resolves the contradiction between dynamic range improvement and luminance uniformity.
2Measurement precision
If moving object region extraction is performed without error assumption, then processing accuracy is improved, but displacement and blur correction becomes more complex
Solution Approach 1:
The patent performs displacement correction and blur reduction processing in advance, before the final image composition. By preliminarily correcting the displacement and blur in each individual image, the system prepares the images for more accurate subsequent processing. This preliminary action simplifies the overall processing complexity while maintaining high accuracy in moving object region detection.
Solution Approach 2:
The patent introduces intermediate processing steps that act as mediators between the raw images and the final composition. These intermediate steps include displacement correction and blur reduction, which prepare the images for more accurate region detection and composition. The intermediary processing simplifies the overall system by breaking down complex tasks into manageable stages.
Data Source
AI summary
An image processing apparatus which composes a plurality of images captured while changing an exposure amount, includes a displacement detection unit which detects a displacement amount between the plurality of images, a correction unit which corrects a displacement between the images based on the displacement amount detected by the displacement detection unit, a moving object region detection unit which detects a moving object region from the plurality of images for which the displacement has been corrected, an image composition unit which composes the plurality of images for which the displacement has been corrected, and a moving object processing unit which replaces a region corresponding to the moving object region of the composite image composed by the image composition unit by an image obtained by performing weighted addition of the plurality of images.