Image Processing Device Blur Integration Noise Reduction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing techniques suffer from noise artifacts and difficulty in achieving proper blur due to strong correlation with the original image, especially when increasing sharpness in focused regions, requiring accurate depth map extraction.

Innovation Solution

An image processing device and method that executes blurring processing on multiple images captured at different focus positions, integrates these images, and applies sharpening based on optical characteristics and blur degrees to generate a composite image with a predetermined blur, while also rotating images to optimize focus and reduce noise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If blurring processing is applied to multiple images at different focus positions, then depth information is enhanced, but noise artifacts increase due to strong correlation with original images

Engineering Contradiction:

Improvedepth information accuracyVSAvoidnoise artifacts

Core Design Contradiction:

Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent segments the image processing into distinct stages: blurring processing on individual images, integration of blurred images, and subsequent sharpening processing. This segmentation allows each stage to optimize for its specific function while minimizing noise artifact propagation

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediate integrated image as a mediator between the blurred source images and the final sharpened output. This intermediate representation separates the depth information extraction from the final image reconstruction, reducing noise correlation

Inventive Principle:

Principle #24Intermediary (Mediator)

2Manufacturing precision

If sharpening processing is applied to increase sharpness in focused regions, then image clarity improves, but artifacts become more perceptible

Engineering Contradiction:

Improveimage sharpnessVSAvoidperceptible artifacts

Core Design Contradiction:

Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent performs blurring processing on multiple images at different focus positions before integration. This preliminary action prepares the images by reducing high-frequency noise components that would otherwise be amplified during subsequent sharpening operations

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent changes the blur degree parameter during processing, applying different blur amounts to images at different focus positions. This parameter variation allows optimized sharpening results while controlling artifact generation

Inventive Principle:

Principle #35Parameter changes

3Manufacturing precision

If accurate depth map extraction is performed to increase sharpness, then focused region clarity improves, but processing complexity increases

Engineering Contradiction:

Improvefocused region sharpnessVSAvoidprocessing complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent enables the image processing system to automatically determine focus positions and blur degrees based on the input images themselves, without requiring external depth maps or complex segmentation algorithms. The system self-adjusts processing parameters to achieve optimal sharpness

Inventive Principle:

Principle #25Self-service

4Loss of information

If multiple images at different focus positions are integrated, then depth information is enhanced, but noise correlation with original images increases

Engineering Contradiction:

Improvedepth information retentionVSAvoidnoise correlation

Core Design Contradiction:

Loss of informationVSReliability

Solution Approach 1:

The patent segments the integration process into controlled stages with intermediate processing steps, allowing noise correlation to be managed at each stage rather than accumulating across the entire process

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS11928794B2Image processing device, image processing program, image processing method, and imaging device

Publication Date: 2024.03.12 NIKON CORP

AI summary

An image processing device includes a first processing unit which executes blurring processing in a common focus position on each of plural images in mutually different focus positions, an integration unit which generates an integrated image resulting from integration of the plural images on which the blurring processing is executed, and a second processing unit which generates a composite image having a predetermined blur degree by executing sharpening processing on the integrated image generated by the integration unit based on information in which optical information indicating optical characteristics of an optical system in which the plural images are acquired and a blur degree of the blurring processing in the common focus position are composited together along a depth direction of the plural image.