Luminance Correction for Multi-Wavelength Image Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in combining images from different wavelength bands, such as visible and non-visible light, resulting in luminance differences that reduce color reproducibility and create a strange visual effect due to spectral characteristics and illumination differences.

Innovation Solution

An apparatus and method that acquire images from different wavelength bands, correct the luminance of non-visible light images to match the luminance distribution of visible light images, and combine the corrected luminance with chromaticity information to generate a composite image, ensuring the luminance distribution of the composite image aligns with the visible light image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If color image data and monochrome image data with different wavelength bands are combined directly, then composite image data can be generated, but luminance information differs between the images causing reduced color reproducibility and strange visual effects

Engineering Contradiction:
Improvecomposite image generation capabilityVSAvoidcolor reproducibility
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies luminance correction to the monochrome image data before combining it with color image data. The correction unit pre-adjusts the luminance information of the monochrome image to match the luminance distribution of the color image, ensuring that when the images are combined, the luminance information is consistent and color reproducibility is maintained.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the luminance parameter of the monochrome image data by applying a luminance correction value. This correction value is calculated based on the luminance distribution of the color image data, and it modifies the luminance information of the monochrome image to align with the color image's luminance characteristics, thereby resolving the luminance mismatch issue.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If images from different wavelength bands are combined, then multi-spectral information is achieved, but luminance distribution differences cause visual strangeness and reduced quality

Engineering Contradiction:
Improvemulti-wavelength band imaging capabilityVSAvoidvisual quality consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent modifies the luminance parameter of the non-visible light image by calculating a luminance correction value based on the visible light image's luminance distribution. This correction value adjusts the luminance information of the non-visible light image to match the visible light image, ensuring visual quality consistency while maintaining multi-wavelength band imaging capability.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The luminance correction value acts as an intermediary that mediates between the luminance distributions of images from different wavelength bands. By introducing this correction factor, the patent enables seamless integration of multi-spectral images while maintaining visual quality consistency across different wavelength bands.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11457155B2Apparatus, method for controlling, and medium
Publication Date: 2022.09.27 CANON KK
  • US11457155B2 patent drawing
  • US11457155B2 patent drawing
  • US11457155B2 patent drawing

AI summary

There is provided with an image processing apparatus. An acquisition unit acquires a first image captured with visible light and a second image captured with non-visible light. A correction unit corrects luminance of the second image so as to bring luminance distribution of the second image close to luminance distribution of the first image. A generation unit combines the second image whose luminance is corrected by the correction unit and chromaticity information of the first image to generate a composite image.