Image-Capturing Device White Balance Correction for Mixed Illuminance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-capturing devices struggle to accurately capture and balance visible and non-visible light components, especially under varying illuminance conditions such as low light or mixed light sources like solar and halogen light, without causing color imbalances or requiring separate exposure times for different light components.

Innovation Solution

An image-capturing device with a light-capturing element that separates visible and non-visible light signals using color filters and performs white balance correction on visible light signals based on estimated light source color temperature, allowing for simultaneous capture and combination of visible and non-visible light components in a single frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If separate image capturing for visible light and infrared components is performed, then white balance correction can be applied to visible light component, but imaging time is extended and synchronization under varying illuminance becomes difficult

Engineering Contradiction:
Improvewhite balance accuracyVSAvoidimaging time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent combines visible light and infrared imaging into a single simultaneous capture process. The image capturing element captures both visible light and infrared components at the same time, and the signal processing unit separates and processes them together, eliminating the need for separate sequential imaging while maintaining white balance accuracy through combined processing of both components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent enables continuous simultaneous capture of visible light and infrared components throughout the imaging period. By using an image capturing element that responds to both wavelength ranges and processing signals together in real-time, the system maintains continuous useful action for both imaging channels without interruption or sequential delay.

Inventive Principle:
Principle #20Continuity of useful action

2Measurement precision

If infrared LED is controlled for pulse emission, then infrared image signal can be extracted, but device complexity increases and cannot handle ambient infrared light environments

Engineering Contradiction:
Improveinfrared signal extraction accuracyVSAvoidcontrol system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts infrared component signals directly from the combined pixel signals captured by the image capturing element, without requiring separate infrared LED control systems. The signal processing unit separates infrared components from the total captured light through spectral analysis and processing, eliminating the need for active infrared illumination control while maintaining extraction accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The image capturing element and signal processing unit work together to automatically separate and process infrared components from ambient light without external control. The system self-services by capturing both visible and infrared components simultaneously and autonomously separating them through signal processing, eliminating the need for external infrared LED control mechanisms.

Inventive Principle:
Principle #25Self-service

3Productivity

If visible light and infrared components are captured simultaneously, then imaging speed is improved, but color balance becomes difficult to control under varying illuminance

Engineering Contradiction:
Improveimaging speedVSAvoidcolor balance accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback processing where the signal processing unit continuously analyzes the combined pixel signals from both visible light and infrared components, adjusts the separation and processing parameters based on the actual captured data, and optimizes color balance dynamically. This feedback mechanism ensures accurate color balance is maintained under varying illuminance conditions while preserving the benefits of simultaneous imaging.

Inventive Principle:
Principle #23Feedback

4Device complexity

If white balance correction is applied only to visible light component, then processing is simplified, but overall image color accuracy deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoidoverall image color accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies white balance correction universally to both visible light and infrared component signals through the signal processing unit. The processing system performs multi-functional operations by separating the components, applying appropriate corrections to each based on their respective characteristics, and then combining them to achieve overall image color accuracy that accounts for both wavelength ranges.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate extraction and combination of visible and non-visible light signals at the same exposure time, improving color balance and reducing the risk of pseudo colors, while maintaining superior white balance correction and image quality across various illumination environments.

Implementation Method 1

an image-capturing element that executes photoelectric conversion on light including visible light and non-visible light and outputs a pixel signal

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10165242B2Image-capturing method and image-capturing device
Publication Date: 2018.12.25 HITACHI INDUSTRY & CONTROL SOLUTIONS LTD
  • US10165242B2 patent drawing
  • US10165242B2 patent drawing
  • US10165242B2 patent drawing

AI summary

Provided is an image-capturing device including: a visible light signal generating unit that extracts a visible light signal from a pixel signal from an image-capturing element; a light source color estimating unit that estimates a color temperature of a light source from the visible light signal; a white-balance adjusting unit that performs white balance correction on the visible light signal according to an estimation result; a non-visible light signal generating unit that extracts a non-visible light signal from the signals from the image-capturing element; and an image composing unit that combines and outputs the visible light signal on which the white balance correction was performed and the non-visible light signal.