HDR Image Composition Using Motion Detection and Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image composition tools are inadequate in producing satisfactory high dynamic range (HDR) images, particularly failing to effectively handle motion defects such as those found in scenes like waterfalls or moving people, from low dynamic range (LDR) images captured at different exposure levels.

Innovation Solution

An image composition system comprising an image detection unit and an image composition unit that detects marked parts in LDR images, sets exposure history data, and synthesizes these images into HDR images by dividing them into marked and unmarked areas, using a partial composition unit, standard composition unit, and digital blending unit, with the option of employing a response function for brightness calculation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional image composition tools are used to synthesize HDR images from LDR images, then the basic HDR composition can be achieved, but motion defects such as waterfalls and moving people cannot be effectively eliminated

Engineering Contradiction:
ImproveHDR image qualityVSAvoidmotion defect handling
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the image composition process into multiple units: image detection unit that identifies marked parts (motion defects), image composition unit that sets exposure history data, partial composition unit for marked areas, standard composition unit for unmarked areas, and digital blending unit. This segmentation allows different handling strategies for different image regions, effectively resolving motion defects while maintaining overall HDR quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by treating marked parts (motion defects) differently from unmarked parts. The partial composition unit processes marked areas with specialized algorithms that account for motion, while the standard composition unit handles static areas. This localized approach eliminates motion defects in specific regions without affecting the overall image composition.

Inventive Principle:
Principle #3Local quality

2Illumination intensity

If multiple LDR images are combined to create HDR images, then the dynamic range is improved, but the complexity of the composition process increases

Engineering Contradiction:
Improvedynamic rangeVSAvoidcomposition process complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by detecting marked parts in LDR images before the actual composition process. The image detection unit identifies motion defects and marks them in advance, and the image composition unit sets exposure history data beforehand. This preliminary processing simplifies the subsequent composition steps by pre-organizing the data structure and identifying problem areas that need special handling.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary structures: exposure history data that mediates between multiple LDR images, and a database that stores and manages this exposure history. These intermediaries organize the complex multi-image data into a manageable format, facilitating the synthesis process while maintaining the benefits of multiple exposure levels.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If digital image processing methods are used to post-process captured images, then HDR composition becomes possible, but satisfactory results especially for motion defects cannot be achieved

Engineering Contradiction:
ImproveHDR composition capabilityVSAvoidimage reproduction accuracy
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent introduces dynamics by making the composition process adaptive rather than static. The system dynamically identifies marked parts through image detection, dynamically sets exposure history data based on detected motion defects, and dynamically selects different composition strategies for marked versus unmarked areas. This dynamic approach allows the system to adapt to various motion scenarios and achieve satisfactory results across different image types.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback mechanisms where the image detection unit continuously monitors LDR images for motion defects, and this detection feedback guides the composition process. The system uses the detected marked parts as feedback to adjust the composition strategy, ensuring that motion defects are appropriately handled in the final HDR image while maintaining accuracy in static regions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS7443533B2Image composition systems and methods
Publication Date: 2008.10.28 COREL CORP
  • US7443533B2 patent drawing
  • US7443533B2 patent drawing
  • US7443533B2 patent drawing

AI summary

An image composition system. The image composition system comprises an image detection unit and an image composition unit. The image detection unit detects marked parts in low dynamic range images. The low dynamic range images are images of the same scene taken at different exposure levels. The image composition unit sets exposure history data of the low dynamic range images according to the marked parts. The image composition unit then synthesizes the low dynamic range images into a high dynamic range image according to the exposure history data.