3D Depth-Based Image Blur Simulation for Small Sensor Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital cameras with small image sensors struggle to capture shallow depth-of-field images due to their smaller optical systems, which limits their ability to create artistic blurring effects that draw attention to a specific portion of the image.

Innovation Solution

A cinematic blur module analyzes 3D depth information from a 3D camera to calculate a blur factor for each object based on its distance from the subject, applying a blur filter in post-processing to simulate the effects of a large optical system, allowing for the creation of shallow depth-of-field images without the need for a large camera system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If a digital camera uses a small image sensor to achieve portability, then the camera size is reduced, but the ability to capture shallow depth-of-field images is lost

Engineering Contradiction:
Improvecamera sizeVSAvoiddepth-of-field quality
Core Design Contradiction:
Volume of moving objectVSManufacturing precision

Solution Approach 1:

The patent applies a computational blur filter to digitally replicate the optical blur effect produced by large-aperture lenses. Instead of relying on physical optical properties, the system creates a digital copy of the shallow depth-of-field effect by analyzing depth information and applying appropriate blur amounts to different regions of the image, thereby achieving the artistic effect with a small sensor camera.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the approach from optical parameters (lens aperture, focal length) to computational parameters (blur amount, depth thresholds). By adjusting computational parameters in software, the system can simulate various depth-of-field effects that would traditionally require specific optical configurations, allowing small-sensor cameras to achieve effects previously only possible with large optical systems.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If a camera uses a large optical system to capture shallow depth-of-field images, then the blur quality is improved, but the camera becomes less portable

Engineering Contradiction:
Improveblur qualityVSAvoidportability
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical/optical system (large lens and sensor) with a computational system (image processing algorithms). Instead of using physical optics to create blur, the system uses digital image processing to apply blur filters based on depth information, substituting mechanical complexity with computational simplicity and enabling portability without sacrificing blur quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If a small sensor camera is used, then portability is improved, but the natural optical blurring effect is reduced

Engineering Contradiction:
ImproveportabilityVSAvoidlack of optical blurring
Core Design Contradiction:
Ease of operationVSObject-generated harmful factors

Solution Approach 1:

The patent converts the limitation of small sensors (inability to produce natural optical blur) into an opportunity for computational creativity. By using depth maps and region-based processing, the system applies blur selectively to background and foreground elements, transforming the optical limitation into a flexible post-processing advantage that can achieve even more precise control over which elements are blurred.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS10015469B2Image blur based on 3D depth information
Publication Date: 2018.07.03 GOPRO INC
  • US10015469B2 patent drawing
  • US10015469B2 patent drawing
  • US10015469B2 patent drawing

AI summary

Blurring is simulated in post-processing for captured images. A 3D image is received from a 3D camera, and depth information in the 3D image is used to determine the relative distances of objects in the image. One object is chosen as the subject of the image, and an additional object in the image is identified. Image blur is applied to the identified additional object based on the distance between the 3D camera and the subject object, the distance between the subject object and the additional object, and a virtual focal length and virtual f-number.