Image Processing White Balance Correction via Shape and Light Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing techniques for adjusting white balance require complex mechanisms like micro lens arrays, increasing costs and reducing accuracy due to insufficient image disparities, making it difficult to appropriately correct white balance, especially under varying lighting conditions.

Innovation Solution

An image processing apparatus that captures images with and without auxiliary light, generates shape information using a three-dimensional shape model, calculates the contribution rate of auxiliary light, and combines corrected images based on this information to adjust white balance effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a micro lens array is used to acquire distance images for white balance correction, then white balance correction accuracy is improved, but device complexity and manufacturing cost increase

Engineering Contradiction:
Improvedistance image accuracyVSAvoidmechanism complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the essential function of the micro lens array (acquiring distance information) and implements it through software processing of ordinary captured images. By analyzing image brightness distribution and applying inverse square law calculations, the system obtains distance information without the physical micro lens array structure, thereby simplifying the device while maintaining the core functionality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical/optical micro lens array system with a computational approach. Instead of using physical lens structures to create disparity images, the system uses image processing algorithms to calculate distance information from standard captured images, substituting a mechanical system with a software-based solution.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If a micro lens array is used to generate distance images, then distance information can be obtained, but image disparity becomes insufficient under certain capturing conditions, lowering measurement accuracy

Engineering Contradiction:
Improvedistance image accuracyVSAvoiddistance image acquisition reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent changes the approach from relying on optical parameters (lens array physical structure) to using computational parameters (image brightness analysis, inverse square law calculations). By changing from a fixed optical mechanism to a flexible computational method that can adapt to different capturing conditions, the system maintains reliability across varying scenarios.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If complex mechanisms like micro lens arrays are used for white balance correction, then correction accuracy is improved, but manufacturing cost increases

Engineering Contradiction:
Improvewhite balance correction accuracyVSAvoidmanufacturing cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent replaces expensive, complex optical components (micro lens arrays) with inexpensive computational methods. The solution uses standard image processing on ordinary captured images, eliminating the need for costly specialized hardware while achieving the same white balance correction functionality.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11509797B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2022.11.22 CANON KK
  • US11509797B2 patent drawing
  • US11509797B2 patent drawing
  • US11509797B2 patent drawing

AI summary

An apparatus includes a generation unit configured to generate shape information of an object in a captured image, a component acquisition unit configured to acquire an auxiliary light component representing intensity of an auxiliary light at each pixel of the captured image based on a light amount characteristic representing a light amount of the auxiliary light received by the object when the auxiliary light is emitted and the shape information of the object, a first correction unit configured to generate a first corrected image in which color of the captured image is corrected according to environmental light, a second correction unit configured to generate a second corrected image in which color of the captured image is corrected according to the auxiliary light, and a combining unit configured to combine the first corrected image and the second corrected image at a combination ratio calculated based on the auxiliary light component.