Image Synthesis Unit Bayer Matrix Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing handshake correcting techniques for image-adding-type image capturing apparatuses face inefficiencies due to the heavy process load caused by converting Bayer matrix images to RGB images, which results in limited improvement in image processing efficiency.

Innovation Solution

The apparatus includes an image pickup device with photoelectric conversion elements arranged in a predetermined pattern, an acquisition unit for successive image acquisition, and a synthesis unit that compensates positional deviations by adding images with the same color layout as the photoelectric conversion elements, reducing the synthesis process load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If Bayer matrix images are converted to RGB images for synthesis, then color information is improved, but process load increases

Engineering Contradiction:
Improvecolor informationVSAvoidprocess load
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent performs color interpolation (converting Bayer matrix to RGB) only once on the reference image before synthesis, rather than converting each captured image separately. This preliminary action reduces the total number of conversions from N+1 to just 1, significantly lowering process load while maintaining color information quality in the final synthesized image

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the color interpolation step with the reference image preparation phase, combining two operations (conversion and synthesis) into a more efficient workflow where only the reference image undergoes full color conversion, and subsequent images are synthesized directly in Bayer matrix format

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If multiple RGB images are synthesized for handshake correction, then image quality is improved, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The reference image is pre-converted to RGB format and stored before the actual synthesis process. When multiple images need to be synthesized for handshake correction, the system only needs to perform addition operations on Bayer matrix images against this pre-converted reference, rather than converting each image individually, thus reducing processing time while maintaining image quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies color conversion only partially - specifically to the reference image or to the final synthesized result - rather than converting all intermediate images. This partial action approach maintains sufficient color information for high-quality output while avoiding the excessive processing time that would result from full conversion of all images in the sequence

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces the synthesis process load by synthesizing images with the same color layout as the image pickup device, resulting in shorter processing times and improved efficiency compared to traditional methods.

Implementation Method 1

an image pickup device in which photoelectric conversion elements corresponding to color components are arranged in a predetermined pattern

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS7903155B2Image capturing apparatus and program
Publication Date: 2011.03.08 KONICA MINOLTA INC
  • US7903155B2 patent drawing
  • US7903155B2 patent drawing
  • US7903155B2 patent drawing

AI summary

An image capturing apparatus includes: an image pickup device in which photoelectric conversion elements corresponding to color components are arranged in a predetermined pattern; an acquisition unit that successively acquires a plurality of images by using the image pickup device; a detector that detects a positional deviation among the plurality of images; and a synthesis unit that compensates the positional deviation to synthesize the plurality of images by addition, wherein the synthesis unit adds the plurality of images in a state where the images have the same color layout as that of the photoelectric conversion elements in the image pickup device.