Image Sensor Signal Line Defect Correction via Preliminary Action

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image capturing apparatuses face challenges in handling defects caused by short-circuited signal lines, which can lead to mixed signals and affect the quality of parallax images, making it difficult to perform processes like focusing or generating virtual viewpoint images.

Innovation Solution

An image capturing apparatus that includes a reading unit for separate signal readout from photoelectric conversion elements, a correction unit to address defective signal lines, and a generation unit to create a corrected image file, allowing for the reduction of defects in parallax images and improved image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If signals from multiple photoelectric conversion elements are read out separately via a common signal line, then individual signal quality is improved, but signal line defects cause mixing and reduce reliability

Engineering Contradiction:
Improvesignal qualityVSAvoidsignal line defect
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by detecting defective signal lines before they affect image processing. The system performs a test reading operation to identify defective signal lines in advance, stores defect information, and then uses this information to exclude defective signals from subsequent parallax image generation and processing. This prevents defect propagation while maintaining the benefits of separate signal readout.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts and removes defective signals from the image processing pipeline. By identifying signals from pixels with defective signal lines and excluding them from parallax image generation and processing, the system separates good signals from bad signals. This ensures that only reliable signals contribute to the final image quality and processing accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If defective signals are included in parallax image processing, then processing speed is maintained, but image quality and processing accuracy deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidimage processing accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs defect detection in advance through a test reading operation before actual image processing. By pre-identifying defective signal lines and storing their locations, the system avoids the need for complex real-time defect detection during processing. This preliminary action maintains processing speed while ensuring accuracy by excluding known defective signals.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using defect detection results to guide subsequent image processing operations. The system feeds back the defect information to the image processing unit, which then adjusts its operations to exclude defective signals. This feedback mechanism ensures high processing accuracy without significantly impacting processing speed, as the defect information is reused across multiple processing stages.

Inventive Principle:
Principle #23Feedback

3Device complexity

If a simple reading operation is performed without defect detection, then device complexity is reduced, but defect influence on images increases

Engineering Contradiction:
Improvesystem complexityVSAvoiddefect influence
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The patent adds a preliminary defect detection step that identifies defective signal lines before they affect image quality. By performing this simple test reading operation and storing defect information, the system prevents defect propagation throughout the imaging process. The added complexity is minimal and focused solely on defect identification, while the benefit is significant reduction in defect influence on final images.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces defect information as an intermediary element between the signal reading operation and image processing. This intermediary data structure stores locations of defective signal lines and is used by subsequent processing stages to exclude defective signals. The intermediary approach adds minimal complexity while effectively blocking the transmission of defect influence from signal lines to final images.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution reduces the influence of defects on recorded parallax images and enhances image processing quality by correcting defective signals and excluding them from calculations, thereby maintaining high accuracy and image quality.

Implementation Method 1

an image sensing device including a plurality of groups of pixels, each pixel of each group of pixels including a plurality of photoelectric conversion elements

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10855887B2Image capturing apparatus, image processing apparatus, and control method therefor
Publication Date: 2020.12.01 CANON KK
  • US10855887B2 patent drawing
  • US10855887B2 patent drawing
  • US10855887B2 patent drawing

AI summary

In an image capturing apparatus, an image sensing device includes a plurality of groups of pixels each including a plurality of photoelectric conversion elements, signals from the plurality of photoelectric conversion elements being readable separately for each photoelectric conversion element via a signal line used in common by each group of pixels. A reading unit performs, on a plurality of groups of pixels, a reading-out operation to reading out a signal as a first signal from part of the plurality of photoelectric conversion elements and a second reading-out operation to mix signals from the plurality of photoelectric conversion elements and read out a resultant mixed signal as an image signal. A generation unit generates one image file including the first signal, the image signal, and defect data indicating a group of pixels for which the first signal is defective while the image signal is not defective.