Imaging Device Fixed Pattern Noise Estimation Using Partial Pixel Readout

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging devices experience a significant reduction in continuous shooting speed due to the time required to read and process fixed pattern noise, leading to buffer memory occupation and a decrease in the number of recordable frames.

Innovation Solution

An imaging device with an image capturing unit, noise obtaining unit, and noise eliminating unit that calculates and subtracts fixed pattern noise in real-time by reading noise outputs from partial areas of the pixel array, allowing for efficient estimation and elimination of fixed pattern noise without delaying image data flow.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fixed pattern noise is read and processed for one screen, then image quality is improved, but continuous shooting speed is lowered

Engineering Contradiction:
Improveimage qualityVSAvoidcontinuous shooting speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent divides the pixel array into multiple regions and reads noise data only from specific regions (e.g., first and second regions) rather than the entire screen. This segmentation approach reduces the amount of noise data that needs to be read and processed, thereby improving continuous shooting speed while still maintaining effective fixed pattern noise elimination through the use of read noise data in combination with stored fixed pattern noise.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If fixed pattern noise for multiple screens is read and averaged, then fixed pattern noise elimination accuracy is improved, but the delay in continuous shooting speed becomes prominent

Engineering Contradiction:
Improvefixed pattern noise elimination accuracyVSAvoidcontinuous shooting delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by storing fixed pattern noise data for multiple screens in advance in a buffer memory during periods when continuous shooting is not occurring or during idle time. This allows the system to have pre-prepared noise data ready for use, eliminating the need to read and process noise data in real-time during continuous shooting operations, thus maintaining high shooting speeds while still achieving accurate noise elimination.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If read fixed pattern noise is stored in buffer memory, then noise elimination is enabled, but buffer memory becomes fully occupied quickly, delaying continuous shooting

Engineering Contradiction:
Improvenoise elimination capabilityVSAvoidcontinuous shooting speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts only the essential noise data from specific regions of the pixel array rather than reading and storing noise data from the entire screen. By taking out only the necessary portions of noise data and combining them with previously stored fixed pattern noise, the system reduces buffer memory usage and avoids memory saturation, thereby maintaining high continuous shooting speeds while still achieving effective noise elimination.

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If fixed pattern noise for one screen is stored in addition to captured images, then noise elimination is possible, but the number of recordable frames in memory card is reduced

Engineering Contradiction:
Improvenoise elimination capabilityVSAvoidnumber of recordable frames
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent uses a copying approach by utilizing stored fixed pattern noise data from previously captured screens and combining it with newly read noise data from specific regions. This creates a virtual representation of comprehensive noise data without physically storing all the raw noise data for every screen in the buffer memory. The system effectively copies and reuses noise patterns across multiple frames, reducing memory requirements while maintaining noise elimination capability.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables real-time elimination of fixed pattern noise, reducing the time required for photographing sequences, maintaining high-speed continuous shooting, and optimizing memory usage by minimizing the storage of fixed pattern noise, thus improving image quality and increasing the number of frames that can be recorded.

Implementation Method 1

generates image data by photoelectrically converting, pixel by pixel, a subject image formed on an available pixel area

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS8300977B2Imaging device and image processing program for estimating fixed pattern noise from partial noise output of available pixel area
Publication Date: 2012.10.30 NIKON CORP
  • US8300977B2 patent drawing
  • US8300977B2 patent drawing
  • US8300977B2 patent drawing

AI summary

An imaging device of the present invention includes an image capturing unit, a noise obtaining unit, a fixed noise calculating unit, and a noise eliminating unit. The image capturing unit generates image data by photoelectrically converting, pixel by pixel, a subject image formed on an available pixel area of a light-receiving surface. The noise obtaining unit reads a noise output from a partial area of the available pixel area. The fixed noise calculating unit calculates an estimation of fixed pattern noise of the available pixel area based on the noise output read from the partial area. The noise eliminating unit subtracts the fixed pattern noise from the image data.