Array Camera Calibration for Pixel Defect and Geometric Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Array cameras require specialized calibration processes to address unique characteristics and defects in their imaging components, which are not common in conventional cameras, and need methods to detect and correct pixel defects and geometric variations for effective image processing.

Innovation Solution

The calibration process designates reference and associate imaging components, performing defect detection, geometric calibration, MTF calibration, and photometric calibration to identify and correct pixel defects and variations, ensuring uniformity and alignment of image data across components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional calibration processes are used for array cameras, then general imaging characteristics can be measured, but unique characteristics of array cameras (uniformity of intrinsic characteristics among elements and extrinsic geometric relationships) cannot be properly quantified

Engineering Contradiction:
Improvequantification of array camera unique characteristicsVSAvoidapplicability of conventional calibration processes
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The calibration process is divided into distinct segments: defect detection process, geometric calibration process, and MTF calibration process. Each segment addresses specific characteristics of array camera elements, allowing precise quantification of uniformity among elements and geometric relationships without requiring a single comprehensive conventional process.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Defect detection is performed as a preliminary action before geometric and MTF calibration. By identifying and flagging defective pixels in advance, the calibration processes can proceed with accurate data from functional pixels, ensuring precise measurement of array camera characteristics.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If defect detection and multiple calibration processes are performed on each imaging component, then measurement precision and uniformity are improved, but calibration time and process complexity increase

Engineering Contradiction:
Improveuniformity of image data across imaging componentsVSAvoidcalibration process duration
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Multiple calibration processes (defect detection, geometric calibration, MTF calibration) are merged into a single integrated calibration system. By capturing test images and performing all calibration analyses in sequence using the same imaging components, the system achieves high measurement precision while reducing total calibration time compared to separate independent processes.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The calibration system uses the array camera's own imaging components to perform self-calibration. Each imaging component captures test images that are analyzed to determine its own defect status, geometric relationships, and MTF characteristics, eliminating the need for external calibration equipment and reducing overall calibration time.

Inventive Principle:
Principle #25Self-service

3Reliability

If defect detection is performed to identify pixel defects in each imaging component, then image processing reliability is improved, but processing time and computational complexity increase

Engineering Contradiction:
Improveaccuracy of image processingVSAvoidcomplexity of calibration and image processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

A processor acts as an intermediary between the imaging components and the final image processing. The processor stores calibration data (defect information, geometric relationships, MTF data) for each imaging component and uses this data to guide image processing operations, improving reliability while managing computational complexity through organized data structures.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Defect detection and calibration data generation are performed as preliminary actions before actual image processing. By identifying defective pixels and storing their locations in advance, the image processing algorithms can efficiently bypass or correct for these defects without adding computational complexity during real-time processing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10127682B2System and methods for calibration of an array camera
Publication Date: 2018.11.13 FOTONATION LIMITED
  • US10127682B2 patent drawing
  • US10127682B2 patent drawing
  • US10127682B2 patent drawing

AI summary

Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the detecting of defects in the imaging components of the array camera and determining whether the detected defects may be tolerated by image processing algorithms. The calibration process also determines translation information between imaging components in the array camera for use in merging the image data from the various imaging components during image processing. Furthermore, the calibration process may include a process to improve photometric uniformity in the imaging components.