Image Processing Apparatus Noise Reduction via Color Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems in low-illumination environments generate composite images with significant noise due to the influence of visible light images, which affects the quality of color reproduction.

Innovation Solution

An image processing apparatus that specifies regions with similar color information in visible light images, extracts this information, and superimposes it onto infrared light images captured synchronously, reducing noise by generating a composite image with improved signal-to-noise ratio.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the visible light image is composited intact in the composite image, then the color information is preserved, but the noise from the visible light image is strongly influenced and increases significantly in low-illumination environments

Engineering Contradiction:
Improvecolor informationVSAvoidnoise
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent extracts only the necessary color information from the visible light image (specifically, color data from regions with similar color characteristics) while separating it from the noisy visible light image data. This extraction allows the color information to be preserved and transferred to the invisible light image without carrying the harmful noise, thus resolving the contradiction between maintaining color accuracy and reducing noise.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the visible light image into different regions based on color similarity characteristics. By dividing the image into regions with similar color properties and processing them separately, the system can extract color information from appropriate regions while avoiding noise-prone areas, thereby maintaining color accuracy while reducing overall noise in the composite image.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the composition ratio of visible light image and invisible light image is made variable based on illumination determination, then the adaptability to different lighting conditions is improved, but the noise influence from visible light image remains significant when visible light image is composited intact

Engineering Contradiction:
Improveadaptability to lighting conditionsVSAvoidnoise
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent dynamically adjusts the composition ratio based on illumination conditions while fundamentally changing how the visible light image is processed. Instead of simply varying the ratio while keeping the visible light image intact, the system extracts color information and transfers it to the invisible light image, making the composition process adaptive to lighting conditions while inherently reducing noise influence.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If color information is extracted from specific regions with similar color characteristics and superimposed on the invisible light image, then the noise is reduced and signal-to-noise ratio is improved, but the device complexity increases due to additional processing units

Engineering Contradiction:
Improvesignal-to-noise ratioVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional image processing system where the specifying unit, extraction unit, and composition unit work together to achieve multiple objectives: color information extraction, noise reduction, and composite image generation. This integrated approach, while increasing processing complexity, provides universal functionality that handles both color preservation and noise reduction simultaneously.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11361408B2Image processing apparatus, system, image processing method, and non-transitory computer-readable storage medium
Publication Date: 2022.06.14 CANON KK
  • US11361408B2 patent drawing
  • US11361408B2 patent drawing
  • US11361408B2 patent drawing

AI summary

An image processing apparatus comprising, a specifying unit configured to specify, in a visible light image, a region having color information similar to first color information at a position where the visible light image is designated, an extraction unit configured to extract second color information from the specified region in the visible light image, and, a composition unit configured to generate a composite image by superimposing the second color information on the specified region in an invisible light image synchronously captured by an optical system common to the visible light image.