Control Apparatus for Surface Normal Calculation Using Correlated Imaging State Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods struggle to accurately calculate surface normal information due to the need for manual input of light-source incident angle and the complexity of correcting uneven light distributions, leading to increased calculation load and reduced accuracy.

Innovation Solution

A control apparatus and method that writes additional information on the imaging state, including light-source incident angle and light amount distribution, to facilitate accurate surface normal calculation using multiple light sources, reducing user burden and improving calculation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the light-source incident angle is stored in the imaging apparatus, then the surface normal calculation can be performed, but the user burden increases and the system becomes less adaptable to separate image processing apparatuses

Engineering Contradiction:
Improvesurface normal calculation accuracyVSAvoiduser burden
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing the light-source incident angle information in the imaging apparatus at the time of image capture. This pre-stored information is then automatically utilized during surface normal calculation without requiring user input, thereby reducing user burden while maintaining calculation accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent enhances universality by designing the imaging apparatus to store light-source incident angle information in a standardized format that can be accessed by both the imaging apparatus itself and separate image processing apparatuses. This multi-functional design allows the stored information to serve multiple purposes and be used across different systems without requiring manual re-input.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If manual input of light-source incident angle is required, then the calculation can be performed, but the user burden increases and operation becomes more difficult

Engineering Contradiction:
Improvesurface normal calculation accuracyVSAvoiduser operation difficulty
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies self-service by enabling the imaging apparatus to automatically generate, store, and manage the light-source incident angle information itself, without requiring external user input. The apparatus serves its own need for accurate lighting information by capturing and storing this data during the imaging process, thereby eliminating the burden of manual input while maintaining calculation precision.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If light source environment estimation processing is performed, then the light-source incident angle can be estimated, but the calculation load increases and calculation accuracy decreases due to estimation error

Engineering Contradiction:
Improvesurface normal calculation accuracyVSAvoidcalculation load
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing the exact light-source incident angle information during image capture. This eliminates the need for subsequent light source environment estimation processing, thereby reducing calculation load while maintaining or improving accuracy since the actual measured information is used rather than estimated values.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts and stores the essential light-source incident angle information directly during imaging, separating this critical parameter from the need for complex estimation processing. By extracting and storing this key information upfront, the system avoids the computational burden and accuracy limitations of estimation algorithms while retaining the precision needed for surface normal calculation.

Inventive Principle:
Principle #2Taking out (Extraction)

4Ease of manufacture

If uneven light amount in the image is not corrected, then the processing is simpler, but the surface normal calculation accuracy lowers due to uneven light amount distribution

Engineering Contradiction:
Improveprocessing simplicityVSAvoidsurface normal calculation accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by pre-storing the light amount distribution information of each light source during the imaging process. This pre-stored information is then used to correct uneven light amounts during surface normal calculation, thereby maintaining processing simplicity while improving calculation accuracy through automated correction based on pre-captured lighting conditions.

Inventive Principle:
Principle #10Preliminary action

5Measurement precision

If additional information on imaging state is written and correlated, then the surface normal calculation accuracy improves, but the data processing complexity increases

Engineering Contradiction:
Improvesurface normal calculation accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-organizing and correlating additional imaging state information with the captured images during the imaging process. This pre-correlation of data reduces the complexity of subsequent processing by having all necessary information readily available and properly associated, thereby improving surface normal calculation accuracy without imposing excessive complexity on the processing system.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables accurate and efficient acquisition of surface normal information by correlating additional imaging state information with captured images, thereby simplifying the process and enhancing the precision of surface normal calculation.

Implementation Method 1

an image sensor 102 that captures the object and generates image signals

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 2

a reflection characteristic of the object based on the surface normal of the object and the direction from the object to the light source

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10939090B2Control apparatus, imaging apparatus, illumination apparatus, image processing apparatus, image processing method, and storage medium
Publication Date: 2021.03.02 CANON KK
  • US10939090B2 patent drawing
  • US10939090B2 patent drawing
  • US10939090B2 patent drawing

AI summary

A control apparatus includes a write unit configured to write additional information on an imaging state in acquiring an image captured with at least three light sources located at different positions by correlating the additional information with the image. The additional information is information configured to identify at least one of information on an incident angle of light from each light source toward the object on the image and light amount distribution information of the light emitted from each light source on the image.