Image Synthesis Blending Ratio for False Color Suppression

Solution Overview

Problem

Existing image processing technologies face challenges in generating images with a wide dynamic range while suppressing flickers caused by different optical sources and exposure times, leading to unnatural color reproduction and false colors in blend areas.

Innovation Solution

An image processing apparatus that synthesizes images taken at different exposure times by acquiring a blending ratio varying with components selected from the images and applying it to blend areas, effectively suppressing false colors and color flickers through appropriate white-balance adjustment and blending processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multiple images with different exposure times are synthesized to generate wide dynamic range images, then the dynamic range is improved, but false colors and color flickers are generated in blend areas

Engineering Contradiction:

Improvedynamic rangeVSAvoidcolor accuracy

Core Design Contradiction:

Illumination intensityVSEase of manufacture

Solution Approach 1:

The patent applies different processing methods to different regions of the image based on their characteristics. Specifically, it identifies blend areas where multiple exposure images overlap and applies color correction processing only to these regions, while leaving other areas unchanged. This local differentiation resolves the contradiction by maintaining color accuracy in problematic areas without sacrificing the wide dynamic range benefits in other regions.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent changes color parameters (white balance, color temperature) dynamically based on the exposure time and region being processed. By adjusting these color parameters according to the specific conditions of each image region, the system maintains natural color reproduction across the synthesized wide dynamic range image, resolving the false color issue while preserving dynamic range improvement.

Inventive Principle:

Principle #35Parameter changes

2Illumination intensity

If images with different exposure times are synthesized, then the dynamic range is improved, but flickers from optical sources are amplified

Engineering Contradiction:

Improvedynamic rangeVSAvoidoptical source flickers

Core Design Contradiction:

Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent performs preliminary detection of flicker patterns in the captured images before completing the synthesis process. By identifying flicker characteristics early in the processing pipeline, the system can apply appropriate suppression techniques during the blending stage, preventing flicker amplification while maintaining the dynamic range benefits of multi-exposure synthesis.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent converts the harmful flicker effect into useful information by analyzing the temporal patterns of optical source variations. This analysis is then used to guide the blending process, where flicker-affected regions are selectively processed or weighted differently, transforming the originally harmful flicker signal into a basis for improved image synthesis that maintains dynamic range while suppressing visible flickers.

Inventive Principle:

Principle #22Blessing in disguise (Convert harm into benefit)

3Illumination intensity

If blend areas are created by synthesizing multiple exposure images, then the dynamic range is improved, but unnatural color reproduction occurs in the blend areas

Engineering Contradiction:

Improvedynamic rangeVSAvoidcolor reproduction accuracy

Core Design Contradiction:

Illumination intensityVSReliability

Solution Approach 1:

The patent applies different processing methods to different regions of the image based on their characteristics. Specifically, it identifies blend areas where multiple exposure images overlap and applies color correction processing only to these regions, while leaving other areas unchanged. This local differentiation resolves the contradiction by maintaining color accuracy in problematic areas without sacrificing the wide dynamic range benefits in other regions.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent changes color parameters (white balance, color temperature) dynamically based on the exposure time and region being processed. By adjusting these color parameters according to the specific conditions of each image region, the system maintains natural color reproduction across the synthesized wide dynamic range image, resolving the false color issue while preserving dynamic range improvement.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS8970727B2Image processing apparatus, image taking apparatus, image processing method and image processing program having movement determination

Publication Date: 2015.03.03 SONY SEMICON SOLUTIONS CORP

AI summary

Disclosed herein is an image processing apparatus including a synthesizing processing section configured to synthesize a plurality of images taken at different exposure times wherein, in processing to synthesize the taken images, the synthesizing processing section acquires a taken-image blending ratio varying in accordance with components selected from the taken images and carries out a blending process on a blend area in which pixels of the taken images are to be blended by applying the blending ratio to the blend area.