Bokeh Kernel Shape Determination via Distance and Color Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods for applying a bokeh effect on mobile devices fail to accurately replicate the out-of-focus images captured by actual lenses due to differences in point spread functions, particularly caused by lens diffraction.

Innovation Solution

An image processing device that determines the shape of a kernel based on distance and color information, using a Fresnel kernel to blur specific areas of an image, thereby reproducing the diffraction effect of an actual lens and generating a bokeh image similar to an out-of-focus image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a Gaussian kernel is used for convolution operation to apply bokeh effect, then the processing is simple and fast, but the bokeh effect does not accurately replicate the out-of-focus image captured by actual lens due to diffraction differences

Engineering Contradiction:
Improvesimilarity to actual lens out-of-focus imageVSAvoidkernel determination complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameters of the kernel by determining its shape based on distance information and color information. Instead of using a fixed Gaussian kernel, the system dynamically adjusts kernel parameters to match the diffraction characteristics of actual lenses at different distances and wavelengths, thereby improving the accuracy of the bokeh effect while maintaining computational feasibility.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If distance information and color information are used to determine kernel shape, then the bokeh effect accuracy is improved, but the processing complexity and computational load increase

Engineering Contradiction:
Improvebokeh effect accuracyVSAvoidimage processing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary actions by obtaining distance information through a distance sensor and analyzing color information before applying the convolution operation. By preparing the kernel shape determination in advance based on these inputs, the system reduces real-time computational complexity during the actual bokeh application while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively applies a bokeh effect that closely mimics the image captured using an actual lens, improving the similarity of the processed bokeh image to an out-of-focus image by accounting for lens diffraction, enhancing the realism of the bokeh effect.

Implementation Method 1

a point spread function (PSF) through an actual lens has a distribution different from that of a Gaussian function due to diffraction of the lens

Methodology Applied
Scientific EffectDiffraction: Diffraction

Data Source

PatentUS20240185397A1Method and device for applying a bokeh effect to image
Publication Date: 2024.06.06 SK HYNIX INC
  • US20240185397A1 patent drawing
  • US20240185397A1 patent drawing
  • US20240185397A1 patent drawing

AI summary

An image processor determines a shape of a kernel applied to an image based on at least one of distance information or color information. The image processor generates a bokeh image in which at least a partial area of the image is blurred using the kernel.