Computational Bokeh via Depth Camera and Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing methods require high hardware specifications and are difficult to operate, making it challenging to perform bokeh on the background quickly.
Innovation Solution
A method and apparatus that obtain two-dimensional images and focusing information, determine background areas using depth information, and apply bokeh effects based on depth values, reducing hardware requirements and enabling easy operation for quick bokeh processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If hardware with large aperture or large zooming is used to perform bokeh, then bokeh effect quality is improved, but hardware requirements increase and operation becomes difficult
Solution Approach 1:
The patent replaces the mechanical/optical system (large aperture lens, zooming mechanism) with a computational system. The processor analyzes the captured image, identifies the background area, and applies artificial bokeh effects through image processing algorithms. This substitution eliminates the need for specialized optical hardware while achieving the desired bokeh effect through software-based depth simulation.
2Manufacturing precision
If hardware with large aperture or large zooming is used to perform bokeh, then bokeh effect quality is improved, but operation speed decreases
Solution Approach 1:
The system performs preliminary actions by capturing both a color image and a depth map simultaneously. The depth map is pre-processed to identify background areas before the actual bokeh effect is applied. This preliminary segmentation allows the bokeh effect to be applied quickly and efficiently without requiring time-consuming post-processing or manual adjustments.
3Manufacturing precision
If traditional optical methods are used for bokeh, then bokeh effect is achieved, but ease of operation deteriorates
Solution Approach 1:
The system performs self-service by automatically analyzing the captured image, generating a depth map, identifying the background area, and applying the bokeh effect without user intervention. The processor autonomously completes the entire bokeh processing pipeline, making the operation as simple as capturing the image and outputting the result, thereby greatly improving ease of operation.
Data Source
AI summary
An apparatus for image processing includes a processor and a depth camera. The processor obtains a first two-dimensional image and focusing information of the first two-dimensional image, and obtains depth information of a part or all of a content captured in the first two-dimensional image via the depth camera. The processor determines a background area of the first two-dimensional image according to the focusing information. The processor also performs bokeh on the background area of the first two-dimensional image according to the depth information.