Image Processing Device Demosaicing and Point Image Restoration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to adequately address aliasing caused by chromatic aberration and demosaicing in image restoration processes, leading to image deterioration and reduced quality.

Innovation Solution

An image processing device that performs demosaicing, acquires luminance system image data, and executes a point image restoration process with control based on imaging information and analysis, specifically considering the generation degree of aliasing due to chromatic aberration, to improve image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If the point image restoration process is performed on mosaic image data before demosaicing, then false color is reduced, but aliasing caused by chromatic aberration and demosaicing is not addressed and may involve image deterioration

Engineering Contradiction:
Improvefalse colorVSAvoidimage quality
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The patent divides the image restoration process into separate stages: first performing restoration on luminance data to address false color, then performing restoration on chromaticity data to address aliasing. This segmentation allows each restoration operation to target specific quality issues independently, resolving the contradiction between reducing false color and preventing aliasing-related deterioration

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs the point image restoration process on luminance system image data before the demosaicing process. This preliminary action on luminance data reduces false color generation, and subsequent restoration on chromaticity data addresses aliasing. The preliminary restoration prevents harmful effects from compounding during later processing stages

Inventive Principle:
Principle #10Preliminary action

2Object-affected harmful factors

If the restoration degree is decreased to suppress false color, then false color is reduced, but chromatic aberration of magnification is generated

Engineering Contradiction:
Improvefalse colorVSAvoidchromatic aberration of magnification
Core Design Contradiction:
Object-affected harmful factorsVSObject-generated harmful factors

Solution Approach 1:

The patent segments the restoration operation into separate processing stages for luminance and chromaticity components. By performing restoration on luminance data first (which has higher susceptibility to false color) and then on chromaticity data, the system can optimize restoration degree for each component independently, suppressing false color without introducing chromatic aberration of magnification

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different restoration strategies to different components of the image data. The luminance component receives restoration treatment to reduce false color, while the chromaticity component receives restoration to address aliasing. This local differentiation of quality treatment allows suppression of false color without compromising chromaticity integrity

Inventive Principle:
Principle #3Local quality

3Object-generated harmful factors

If the point image restoration process is performed on demosaicing image data, then aliasing is reduced, but false color may be generated more prominently

Engineering Contradiction:
ImprovealiasingVSAvoidfalse color
Core Design Contradiction:
Object-generated harmful factorsVSObject-affected harmful factors

Solution Approach 1:

The patent separates the restoration process into two distinct stages: first restoring luminance data to minimize false color, then restoring chromaticity data to minimize aliasing. This segmentation prevents the restoration operation from simultaneously targeting both components with the same parameters, which would cause false color to dominate if restoration was applied to demosaicing data

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs restoration on luminance system image data before demosaicing as a preliminary action. This preliminary restoration establishes a foundation that reduces false color, and subsequent restoration on the demosaicing data can then focus on addressing aliasing without the false color issue interfering

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9432643B2Image processing device, image capture device, image processing method, and non-transitory computer-readable medium
Publication Date: 2016.08.30 FUJIFILM CORP
  • US9432643B2 patent drawing
  • US9432643B2 patent drawing
  • US9432643B2 patent drawing

AI summary

An image processing device includes a demosaicing process device, a luminance system image data acquisition device that acquires luminance system image data as image data regarding the luminance, a point image restoration process execution device, an information acquisition device that acquires control information concerning execution of the point image restoration process on the basis of imaging information concerning an imaging condition of a subject, and a point image restoration process control device.