Image Depth Processing via Geometric Optics Simulation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional image processing methods for smartphones and digital cameras fail to generate natural and continuous depth of field effects due to their smaller apertures, lacking consideration of geometric optics principles, resulting in unnatural blurring of images.

Innovation Solution

An image processing device and method that separates reference images into layers based on depth values, blurs foreground and background images according to their depth values, and applies a fading process to create a simulation image with a natural and continuous depth of field, mimicking the effect of a larger aperture camera.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If a smaller aperture is used in smartphones and digital cameras, then the device becomes more portable and can capture clear photos at any distance, but the ability to generate depth of field effect is lost

Engineering Contradiction:

Improvedevice volumeVSAvoiddepth of field effect

Core Design Contradiction:

Volume of moving objectVSAdaptability or versatility

Solution Approach 1:

The patent replaces the mechanical aperture system with an image processing system. Instead of using a physical aperture to control depth of field, the system uses computational methods to simulate depth of field effects by processing images and depth maps, thereby achieving the depth of field effect without requiring a large mechanical aperture structure.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the parameter approach by using depth values and blur kernels instead of physical aperture size. The system processes images based on depth information and applies appropriate blur parameters to simulate depth of field, transforming the problem from physical aperture control to parameter-based image processing.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If traditional image depth processing methods are used, then depth of field effect can be simulated, but the blurring degree cannot be accurately estimated following geometric optics principles, resulting in unnatural appearance

Engineering Contradiction:

Improvedepth of field effectVSAvoidblurring degree precision

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent implements feedback by using depth maps that are generated from images and then fed back into the processing system to guide the blur application. The depth information continuously refines the blurring process, ensuring that the blurring degree accurately reflects the actual depth distribution in the scene, thereby achieving natural appearance.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent segments the image processing into distinct stages: depth map generation, blur kernel generation based on depth values, and selective blurring application. This segmentation allows precise control over the blurring degree for different depth regions, ensuring geometric optics compliance and natural appearance.

Inventive Principle:

Principle #1Segmentation

3Adaptability or versatility

If blur is applied to the entire background image, then depth of field effect is achieved, but the connection between foreground and background becomes discontinuous

Engineering Contradiction:

Improvedepth of field effectVSAvoidimage continuity

Core Design Contradiction:

Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent applies local quality by differentiating the blur treatment between foreground and background regions. Instead of uniformly blurring the entire background, the system applies selective blurring based on depth values, ensuring that regions closer to the foreground maintain better continuity while farther regions are appropriately blurred, thus preserving image composition stability.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent uses partial action by applying blur only to the extent necessary for depth of field effect, rather than excessive blurring of the entire image. The blur is selectively applied to background regions beyond the focal plane, maintaining the connection and continuity between foreground and background while achieving the desired depth effect.

Inventive Principle:

Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution generates images with a natural and continuous depth of field effect, enhancing the appearance of images by aligning with geometric optics principles, making them look like they were taken with a camera having a larger aperture.

Implementation Method 1

The instant disclosure provides an image processing device and an image depth processing method based on geometric optics

Methodology Applied

Scientific EffectGeometric optics: Geometry

Data Source

PatentUS20160247285A1Image processing device and image depth processing method

Publication Date: 2016.08.25 LITE ON TECH CORP

AI summary

An image depth processing method includes the following steps. A background image and a foreground image in a reference image are obtained according to a depth image corresponding to the reference image. It is noted that the depth value of the background image is larger than the depth value of the foreground image. Meanwhile, the background image is blurred, and then the foreground image and a local image in the blurred background image are blurred. A simulation image is generated according to the background image and the foreground image after blurring the local image and the foreground image.