Image Processing Device for Detecting Unnatural Color Changes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In imaging devices, color reproduction processing can generate unnatural image characteristics when the illumination light's wavelength characteristic differs from the assumed light source, leading to issues like unnatural colors and gradations, especially when using LED light sources with narrow bandwidths.

Innovation Solution

An image processing device that performs color reproduction processing and includes a unit to detect image areas with significant characteristic changes by comparing image signals before and after processing, using a color reproduction processing unit for white balance adjustment, color gradation conversion, or color space conversion, and a detection unit that sets a blend ratio to correct for unnatural changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If color reproduction processing is performed on image signals captured under LED illumination with narrow bandwidth, then natural colors and desired color characteristics can be achieved under assumed illumination, but unnatural colors and gradations are generated in areas illuminated by LED light sources

Engineering Contradiction:
Improvecolor reproduction accuracyVSAvoidunnatural image characteristics
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The image is divided into multiple areas based on illumination characteristics. The area detection unit segments the image into areas illuminated by different light sources (assumed illumination vs. LED illumination), allowing different processing to be applied to each segment. This resolves the contradiction by enabling accurate color reproduction in areas with assumed illumination while preventing unnatural characteristics in LED-illuminated areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing strategies are applied to different regions of the image based on local illumination characteristics. In areas illuminated by LED light sources, the blend processing unit applies a different blend ratio than in areas with assumed illumination, ensuring that each region receives appropriate processing to avoid unnatural characteristics while maintaining overall color accuracy.

Inventive Principle:
Principle #3Local quality

2Reliability

If color reproduction processing is applied to all image areas, then overall color characteristics are improved, but unnatural characteristics are introduced in specific areas with different illumination

Engineering Contradiction:
Improveoverall color reproductionVSAvoidimage characteristic consistency
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The processing applied to each image area is dynamically adjusted based on detected illumination characteristics. The blend ratio is not fixed but varies according to the specific area's illumination type, allowing the system to maintain overall color reproduction quality while adapting locally to prevent unnatural characteristics in LED-illuminated regions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The area detection unit provides feedback about illumination characteristics to the blend processing unit, which then adjusts processing parameters accordingly. This feedback mechanism enables the system to maintain consistent image characteristics across different illumination areas while preserving overall color reproduction accuracy.

Inventive Principle:
Principle #23Feedback

3Use of energy by moving object

If LED light sources with narrow bandwidth are used, then energy efficiency and longevity are improved, but color reproduction accuracy deteriorates due to wavelength characteristic differences from assumed illumination

Engineering Contradiction:
Improveenergy efficiencyVSAvoidcolor reproduction accuracy
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The system changes processing parameters (blend ratios) based on the illumination source characteristics. When LED illumination is detected, the system adjusts the blend ratio to compensate for the narrow bandwidth effect, thereby maintaining color reproduction accuracy while allowing the continued use of energy-efficient LED light sources.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11172173B2Image processing device, image processing method, program, and imaging device
Publication Date: 2021.11.09 SONY GROUP CORP
  • US11172173B2 patent drawing
  • US11172173B2 patent drawing
  • US11172173B2 patent drawing

AI summary

A signal processing unit performs preprocessing, demosaic processing and color reproduction processing on an image signal. A control unit detects an image area having undergone a characteristic change exceeding a predetermined change amount, by using an image signal before the reproduction processing and an image signal after the color reproduction processing. The control unit associates area information indicating the detection result of the image area having undergone a characteristic change exceeding a predetermined change amount with the image signal after the color reproduction processing, and records the area information on a recording medium, or outputs the area information to an external device. Thus, it becomes possible to detect an image area where a control change caused by color reproduction processing is unnatural.