Light Field Refocus Image Color Blur Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Chromatic aberration correction in light field data leads to differences in sharpness between channels of a refocus image, causing color blur due to blurring from the aperture of the microlens.

Innovation Solution

An image processing apparatus that generates refocus images for each channel based on light field data, derives spatial frequency characteristics, and corrects the images to make sharpness uniform across channels using these characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If chromatic aberration correction is performed based on the method disclosed in Japanese Patent No. 4752031, then chromatic aberration is reduced, but the sharpness of each channel of a refocus image becomes different due to blurring resulting from an aperture of the microlens, causing color blur

Engineering Contradiction:
Improvechromatic aberrationVSAvoidsharpness uniformity
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by modifying the spatial frequency characteristics of each channel based on the virtual refocus position. The correction unit adjusts the spatial frequency characteristics using the derived characteristics and position information to compensate for the blurring differences caused by the microlens aperture, thereby uniforming the sharpness across channels while maintaining chromatic aberration correction

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent employs preliminary action by deriving the spatial frequency characteristics for each channel in advance based on the optical characteristics and the virtual refocus position. This pre-computed information is then used by the correction unit to adjust the refocus images, ensuring uniform sharpness before final image generation

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10225537B2Image processing apparatus, image capturing apparatus, image processing method, and storage medium
Publication Date: 2019.03.05 CANON KK
  • US10225537B2 patent drawing
  • US10225537B2 patent drawing
  • US10225537B2 patent drawing

AI summary

The image processing apparatus according to an embodiment of the present invention corrects a color blur of a refocus image due to light field data. The image processing apparatus includes a generation unit configured to generate a refocus image for each channel at a virtual refocus position based on light field data including a plurality of channels whose wavelengths are different and optical characteristics for each channel of an optical system used to obtain the light field data. Further, the image processing apparatus includes a derivation unit configured to derive spatial frequency characteristics for each channel from the optical characteristics for each channel and the virtual refocus position and a correction unit configured to correct the refocus image for each channel so as to make sharpness uniform based on the spatial frequency characteristics for each channel.