Synthetic Lens Blur With In-Focus Edge Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems lack accuracy and flexibility in generating synthetic depth-based or blur-based effects in digital images, often producing inaccurate blurring, blooming, or image artifacts at edges and depth transitions due to inaccuracies in estimated depth maps and difficulty in detecting depths at transition regions.
Innovation Solution
A lens blur system utilizing a non-destructive pipeline that generates synthetic depth-based lens blur effects through a focal matte, layered depth maps, and highlight guide images, allowing for interactive depth map refinement and luminance adjustment to achieve realistic and customizable blur effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional depth map estimation methods are used to generate synthetic lens blur effects, then the processing speed is fast, but the accuracy of depth detection at transition regions is poor, resulting in inaccurate blurring and image artifacts at edges
Solution Approach 1:
The system performs preliminary action by detecting edges and depth transition regions before applying blur operations. By identifying these critical areas in advance using edge detection algorithms and comparing depth maps across multiple focal planes, the system can preserve sharp edges while applying blur to appropriate regions, preventing artifacts before they occur.
Solution Approach 2:
The system applies local quality by treating different regions of the image differently based on their depth characteristics. Edge regions and depth transition areas are preserved with high fidelity while other regions receive appropriate blur amounts. This is achieved by calculating local blur amounts based on depth variance and edge detection results, ensuring each region receives customized processing.
2Illumination intensity
If aggressive blur operations are applied to achieve strong depth effects, then the lens blur effect intensity is enhanced, but edge accuracy deteriorates, causing blooming and artifacts at depth transitions
Solution Approach 1:
The system applies partial action by selectively applying blur only to regions that require it, rather than uniformly across the entire image. By calculating local blur amounts based on depth information and edge detection, the system applies stronger blur where needed (background regions) while preserving edge accuracy, achieving the desired blur intensity without excessive processing that would cause artifacts.
Solution Approach 2:
The system performs preliminary anti-action by pre-identifying edge regions and depth transition areas before applying blur operations. These identified regions are then protected from aggressive blur processing through masking or reduced blur amounts, counteracting the potential harmful effects of strong blur operations before they can degrade edge quality.
3Productivity
If simple depth map processing is used to maintain processing efficiency, then the computational complexity is low, but the ability to represent realistic light source effects is insufficient
Solution Approach 1:
The system extracts light source information from the image by analyzing luminance patterns and depth characteristics. By separating light source detection as a distinct processing step from general blur operations, the system can efficiently identify and specially process light source regions using techniques like luminance thresholding and depth variance analysis, improving light source representation without significantly increasing overall computational complexity.
Data Source
AI summary
Methods, systems, and non-transitory computer readable storage media are disclosed for generating a lens blur effect in a digital image with in-focus edge rendering. The disclosed system generates a focal matte indicating an in-focus range of depth values of a digital image based on a focus region and a depth map of the digital image. The disclosed system generates a layered depth map comprising foreground depth values and background depth values of pixels across the digital image according to the depth map and the focal matte. The disclosed system also renders the digital image to include a lens blur effect by utilizing the focal matte and the layered depth map to determine a combination of the foreground depth values and the background depth values in connection with a splatting operation.