Depth of Field Synthesis via Ray Tracing Approximation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for simulating depth of field in digital images are either slow, prone to rendering artifacts, or have high memory utilization, and often result in unnatural blurring across depth boundaries or discontinuity artifacts.
Innovation Solution
A ray tracing approximation method is used to synthesize depth of field effects by tracing cones of rays through an aperture-shaped kernel centered about reference pixels, with pseudo-intersections and color sampling adjusted based on focal depth and aperture shape, integrating colors from multiple apertures to produce a more accurate and artifact-reduced output.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If random rays of light are traced and integrated on the lens to simulate depth of field, then accuracy is improved, but processing speed deteriorates
Solution Approach 1:
The patent uses a pinhole camera model to approximate the complex ray tracing process. Instead of tracing actual random rays through the lens aperture, it creates a simplified geometric model that copies the essential depth of field effect, achieving both accuracy and speed by replacing physical ray tracing with mathematical projection
Solution Approach 2:
The patent transforms the ray tracing problem by changing parameters from actual light ray coordinates to pinhole camera projection parameters. By using focal length, aperture size, and scene depth as key parameters in a simplified geometric model, it achieves accurate depth of field synthesis without the computational burden of full ray tracing
2Measurement precision
If an accumulation buffer is used to reorganize rays as multiple pinhole cameras, then depth of field accuracy is improved, but rendering speed deteriorates due to repeated scene rendering
Solution Approach 1:
The patent extracts only the essential geometric relationships needed for depth of field from the complex accumulation buffer approach. It takes out the core function of organizing rays by depth and implements it through a simplified pinhole projection model, eliminating the need for repeated full scene renderings while maintaining depth accuracy
Solution Approach 2:
The patent performs preliminary geometric setup by defining the pinhole camera parameters and projection geometry before rendering. This preliminary action establishes the depth of field framework once, avoiding the need for repeated scene rendering that plagues the accumulation buffer method
3Productivity
If spatially varying blurring is applied to approximate depth of field, then processing speed is improved, but accuracy deteriorates due to unnatural blurring across depth boundaries
Solution Approach 1:
The patent applies local quality by making the blur characteristics depth-dependent through the pinhole projection model. Each pixel's blur amount is determined by its specific depth relationship to the focal plane, creating natural depth boundaries while maintaining processing efficiency through the simplified geometric approach
Data Source
AI summary
Techniques are disclosed for synthesizing depth of field effects in a digital image using ray tracing approximation. For each target pixel in the image, an aperture-shaped kernel is centered about a reference pixel. A cone of rays is traced through the aperture toward the image scene. The trajectory of the rays and the intersections between the rays and objects in the scene are approximated for a given scene depth, focal depth and aperture shape. The color of the pixel lying at the intersection, which may be offset from the target pixel, is sampled. This sampling process is repeated for several apertures bounding the target pixel, where each aperture is centered about a different reference pixel. The resulting color of the target pixel is acquired by integrating the colors of the pixels at each of the resulting intersections.