Imaging Apparatus Mist Correction via Dual-Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image correction methods for misted images captured outdoors are complex and often fail to remove mist effectively in real-time, leading to insufficient image quality due to reliance solely on captured image information.

Innovation Solution

An imaging apparatus equipped with a first image sensor for visible light and a second image sensor for infrared light, along with an information acquisition unit for position and environment data, and an estimation unit to synthesize images based on external factors, reducing mist influence and improving image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional image correction methods using only captured image information are used, then the system complexity is low, but the mist removal effectiveness is insufficient

Engineering Contradiction:
Improvemist removal effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the imaging system into multiple independent components: a first image sensor for visible light, a second image sensor for infrared light, an information acquisition unit for position and environment data, an estimation unit for predicting mist influence, and a synthesis unit for combining images. This segmentation allows each component to specialize in specific functions, improving overall mist removal effectiveness while maintaining manageable system complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an estimation unit as an intermediary that processes position information and environment information to predict mist influence on captured images. This intermediary component bridges the gap between raw sensor data and final image correction, enabling more effective mist removal by providing contextual information about external factors without requiring direct modification of the core imaging sensors.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple image sensors and information acquisition units are added, then the image quality and mist correction accuracy are improved, but the device complexity increases

Engineering Contradiction:
Improvemist detection accuracyVSAvoidnumber of components
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements multi-functionality by designing the synthesis unit to perform multiple operations: it combines visible and infrared images, applies mist correction based on estimation data, and outputs corrected images. This multi-functional approach allows a single unit to handle diverse processing tasks, improving measurement precision without proportionally increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The information acquisition unit performs preliminary actions by collecting position information and environment information before the actual image capture and correction process. This advance data collection enables the estimation unit to predict mist influence more accurately, improving detection precision while distributing the computational load across time rather than requiring all components to operate simultaneously at full capacity.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If real-time processing is implemented using position and environment information, then the productivity and response speed are improved, but the computational requirements and system complexity increase

Engineering Contradiction:
Improveimage processing speedVSAvoidprocessing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by continuously acquiring and preprocessing position information and environment information before actual image capture. This advance preparation enables real-time processing during image capture without requiring complex computational operations at the moment of processing, thereby improving productivity while managing system complexity through temporal distribution of computational tasks.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The estimation unit performs self-service by automatically generating mist influence predictions using pre-acquired position and environment information without requiring manual intervention or complex external processing systems. This autonomous operation improves processing speed and productivity while minimizing the complexity of external control systems.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system quickly detects and corrects misted areas, producing high-quality images with reduced external factor influence, such as mist, by combining visible and infrared data and using position and environment information for real-time processing.

Implementation Method 1

a first image sensor configured to receive light of a first wave range

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a second image sensor configured to receive light of a second wave range other than the first wave range

Methodology Applied
Scientific EffectInfrared Radiation detection: Infrared Radiation

Data Source

PatentUS12143745B2Imaging apparatus, imaging system, and imaging method
Publication Date: 2024.11.12 CANON KK
  • US12143745B2 patent drawing
  • US12143745B2 patent drawing
  • US12143745B2 patent drawing

AI summary

An imaging apparatus includes a first image sensor for receiving light of a first wave range, a second image sensor for receiving light of a second wave range other than the first wave range, an information acquisition unit for acquiring position information relating to the imaging apparatus and environment information relating to an imaging environment of the imaging apparatus, an estimation unit for estimating, for each subject to be imaged by the imaging apparatus, influence of an external factor of the imaging apparatus on a first image, which is obtained from the first image sensor, by using the position information and the environment information that are acquired by the information acquisition unit, and an image synthesis unit configured to synthesize the first image and a second image, which is obtained from the second image sensor, on the basis of the influence estimated by the estimation unit.