Infrared Image Modulation Coefficient Correction for Color Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to generate high-quality color images in night mode using infrared light, as they suffer from color reproduction issues due to differences in infrared and visible light reflectance, leading to inaccurate representation of subjects like black clothing.

Innovation Solution

An image processing device and method that sets and corrects modulation coefficients based on the ratio of infrared and visible luminance information, adjusting brightness parameters to accurately convert infrared luminance and chrominance information into color information, using a modulation coefficient setting unit, a modulation coefficient correcting unit, and a luminance correcting unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If luminance information of infrared image is used without change for color image generation, then infrared imaging capability is maintained, but color reproduction deteriorates due to difference in reflectance between infrared and visible light

Engineering Contradiction:
Improveinfrared imaging capabilityVSAvoidcolor reproduction accuracy
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by introducing modulation coefficients that dynamically adjust the luminance information from infrared images. These coefficients are calculated based on the ratio between infrared and visible light reflectance characteristics, allowing the system to transform infrared luminance data into values that accurately represent visible light appearance. This resolves the contradiction by modifying the parameter (luminance values) to match the target color space while preserving the infrared imaging capability.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If modulation coefficient is set based on ratio between infrared and visible luminance information, then color reproduction is improved, but device complexity increases due to additional correction units

Engineering Contradiction:
Improvecolor reproduction accuracyVSAvoidimage processing structure
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements universality by designing the modulation coefficient correcting unit to perform multiple functions: it calculates reflectance ratios, determines appropriate modulation coefficients, and applies corrections to luminance information. This multi-functional approach improves color reproduction accuracy while minimizing the increase in device complexity by consolidating correction operations into a single versatile unit rather than adding separate specialized components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If modulation coefficient is corrected based on brightness parameter, then color accuracy in varying lighting conditions is improved, but processing time increases

Engineering Contradiction:
Improvecolor accuracy under varying brightnessVSAvoidimage processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing modulation coefficients for different brightness levels and lighting conditions. When processing images, the system quickly retrieves the appropriate pre-computed coefficients based on the current brightness parameter rather than performing complex real-time calculations. This approach maintains high color accuracy across varying lighting conditions while significantly reducing the processing time required for each image.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10560642B2Image processing device, image processing method and imaging device
Publication Date: 2020.02.11 SONY SEMICON SOLUTIONS CORP
  • US10560642B2 patent drawing
  • US10560642B2 patent drawing
  • US10560642B2 patent drawing

AI summary

Provided is an image processing device for improving quality of an image generated using an image obtained when infrared light is radiated and an image obtained when infrared light is not radiated. A modulation coefficient setting unit sets a first modulation coefficient used for correction of infrared luminance information of an infrared image obtained when infrared light is radiated. The first modulation coefficient is set on the basis of a ratio between the infrared luminance information and visible luminance information of a visible image obtained when the infrared light is not radiated. A modulation coefficient correcting unit corrects the first modulation coefficient to a second modulation coefficient on the basis of a parameter indicating brightness of a subject of the visible image or brightness of a photographing environment. A luminance correcting unit corrects the infrared luminance information using the second modulation coefficient.