Camera Array Defect Detection via Parallax-Aware Region Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional camera arrays face challenges in identifying and addressing localized defects, which can render them unsuitable for image synthesis, leading to reduced manufacturing yield and image quality.

Innovation Solution

The method involves capturing image data from camera arrays, dividing it into regions, and using image processing to identify defects based on predetermined criteria, such as pixel defects, Modulation Transfer Function (MTF) measurements, and parallax shifts, to determine if a camera array is defective, and then synthesizing a super-resolution image by disregarding impacted data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional camera arrays are used without defect detection, then manufacturing process is simple, but defective camera arrays are included in final product reducing yield and image quality

Engineering Contradiction:
Improvemanufacturing yieldVSAvoiddefect detection system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing defect detection on camera arrays before they are assembled into final imaging systems. The detection system identifies defective regions in individual camera units prior to integration, allowing defective units to be excluded or repaired before they compromise the overall system performance, thereby improving manufacturing yield without requiring complex post-assembly testing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the defect detection process into modular components: individual camera units are tested separately, each with its own image capture and analysis subsystem. The detection system divides the camera array into discrete testable units, allowing independent evaluation and classification of defects in each unit, which simplifies the overall detection system architecture while maintaining comprehensive coverage

Inventive Principle:
Principle #1Segmentation

2Reliability

If all camera arrays are tested for defects, then image quality is ensured, but testing time and processing complexity increase

Engineering Contradiction:
Improveimage synthesis reliabilityVSAvoiddefect detection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies local quality by focusing defect detection efforts on specific regions and characteristics that are most critical for image synthesis reliability. Rather than uniformly testing all parameters of all camera arrays, the system identifies and prioritizes detection of localized defects in specific regions, using adaptive criteria that concentrate testing resources where they have the greatest impact on final image quality

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying different levels of testing intensity to different camera arrays based on preliminary assessments. Camera units are categorized into different testing groups, with some receiving comprehensive multi-criteria evaluation while others undergo streamlined testing, allowing the system to maintain high reliability standards while reducing average processing time across the entire batch

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If localized defects are identified and camera arrays with defects are rejected, then image synthesis quality is maintained, but manufacturing yield decreases

Engineering Contradiction:
Improvedefect detection precisionVSAvoidmanufacturing yield
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting defect detection thresholds and criteria based on the specific characteristics of each camera array and its intended application. The system modifies detection sensitivity, region-of-interest parameters, and acceptance criteria to match the requirements of different imaging tasks, allowing higher yields for applications with more tolerant specifications while maintaining high precision for critical applications

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent converts the potential harm of rejecting defective camera arrays into benefit by using the defect detection data to improve overall manufacturing processes. Information about common defect patterns, locations, and causes is fed back into the manufacturing system to prevent recurrence, while defective units that fail critical tests are directed to repair facilities, transforming waste into opportunities for process improvement and resource recovery

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

4Measurement precision

If complex defect criteria are used for evaluation, then detection accuracy is improved, but processing complexity and computational requirements increase

Engineering Contradiction:
Improvedefect evaluation accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments complex defect evaluation into a hierarchy of simpler tests: initial screening using basic image quality metrics, followed by region-specific analysis of suspected areas, and finally detailed evaluation only of critical defects. This segmented approach maintains high detection accuracy by applying appropriate levels of analysis complexity only where needed, avoiding the computational burden of uniformly complex evaluation across all camera arrays

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements partial action in defect evaluation by applying full-complexity analysis criteria only to camera units that fail preliminary screening tests. The system uses a two-stage evaluation process where most units are quickly assessed with simplified criteria, and only those showing signs of potential defects undergo the more computationally intensive comprehensive analysis, reducing overall processing complexity while maintaining detection accuracy for problematic units

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10334241B2Systems and methods for detecting defective camera arrays and optic arrays
Publication Date: 2019.06.25 FOTONATION LIMITED
  • US10334241B2 patent drawing
  • US10334241B2 patent drawing
  • US10334241B2 patent drawing

AI summary

Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.