Multiband Image Center Position Correction Lookup Table

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup apparatuses face issues with positional information shifts in multiband images due to distortion caused by lens units imaging light with different wavelengths, leading to incorrect spectroscopic analysis results.

Innovation Solution

A processing apparatus and method that acquire and correct the center position information of object images, generate conversion information for coordinate system transformation, and use this information to generate a combined image, effectively addressing the distortion and positional shifts by employing a processor to execute tasks such as acquisition and processing units within the image pickup system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a plurality of lens units image light with different wavelengths to generate multiband images, then the productivity of image generation is improved, but the manufacturing precision of positional information deteriorates due to distortion

Engineering Contradiction:
Improvemultiband image generation speedVSAvoidpositional information accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing correction values for distortion in a lookup table before actual image processing. The center position acquisition unit acquires center positions of spectral images in advance, and the correction value calculation unit pre-computes distortion correction values based on these center positions. When generating multiband images, the system simply retrieves pre-computed correction values from the lookup table, avoiding real-time complex calculations and maintaining high processing speed while ensuring positional accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary mechanism by using a lookup table as a mediator between the distortion correction requirement and the image processing pipeline. The lookup table stores pre-computed correction values that act as an intermediary data structure, allowing the system to quickly retrieve appropriate correction values without performing complex real-time calculations. This intermediary approach bridges the gap between maintaining high productivity and ensuring manufacturing precision of positional information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If distortion correction is applied to each spectral image, then the measurement precision of positional information is improved, but the device complexity increases

Engineering Contradiction:
Improvepositional information accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the complex distortion correction calculation from the real-time image processing pipeline and separates it into a preliminary setup phase. The correction value calculation unit extracts and pre-computes distortion correction values based on center positions of spectral images, storing them in a lookup table. During actual multiband image generation, the system only needs to perform simple table lookups and basic coordinate transformations, significantly reducing the computational complexity and processing burden during runtime while maintaining high positional accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses copying by creating a simplified representation of distortion correction data in the form of a lookup table. Instead of performing complex distortion correction calculations on each spectral image during runtime, the system pre-computes correction values and copies them into the lookup table. During image processing, the system copies relevant correction values from the lookup table to apply to the images, replacing complex calculations with simple data retrieval and application operations.

Inventive Principle:
Principle #26Copying

3Reliability

If the number of lens units is increased to improve multiband image quality, then the purity of spectral information is improved, but the loss of time in processing increases

Engineering Contradiction:
Improvespectral information qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-acquiring center positions of spectral images from all lens units and pre-calculating distortion correction values before multiband image generation. This preliminary setup creates a lookup table with all necessary correction data, allowing the system to quickly process images from multiple lens units without performing complex real-time calculations. The preliminary action phase shifts the computational burden to before runtime, enabling fast processing during actual multiband image generation even with many lens units.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamics by making the processing system adaptive through the lookup table mechanism. The system dynamically retrieves appropriate correction values from the lookup table based on the specific lens unit and spectral image being processed. This dynamic approach allows the system to efficiently handle variable numbers of lens units and different spectral configurations without requiring reconfiguration of the processing pipeline, maintaining fast processing speeds while supporting high-quality multiband image generation from multiple lens units.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11592333B2Processing apparatus, image pickup apparatus, image pickup system, and processing method
Publication Date: 2023.02.28 CANON KK
  • US11592333B2 patent drawing
  • US11592333B2 patent drawing
  • US11592333B2 patent drawing

AI summary

A processing apparatus combines a plurality of images based on a plurality of object images formed on an imaging plane of an image sensor by a plurality of lens units and to generate a combined image, and includes at least one processor or circuit that serves as an acquisition task configured to acquire information on a center position of each of the plurality of object images on the imaging plane, information on a correspondence relationship between the center position and positions of the plurality of images in the combined image, and conversion information for converting a first coordinate system in the imaging plane into a second coordinate system in the combined image, the conversion information being generated based on a correction function for correcting the plurality of object images, and a processing task configured to generate the combined image using the conversion information.