Depth of Field Simulation via Pupil Dilation and Brightness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for simulating depth of field in video games, especially with head-mountable displays, often result in unrealistic renderings due to computational expense and inability to dynamically adjust focus based on viewer interactions, leading to a lack of immersion and realism.
Innovation Solution
The method involves simulating depth of field by detecting the viewer's pupil dilation and environmental brightness to adjust the blurring function in rendered images, using techniques such as Gaussian blur and bokeh emulation, to create a more immersive and realistic focus effect.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If ray tracing methods are used to simulate depth of field, then the realism and immersion of the image is improved, but the computational cost and processing time increases significantly
Solution Approach 1:
The patent replaces expensive ray tracing computations with inexpensive 2D projection and blurring operations that can be applied to pre-rendered images. Instead of performing complex 3D ray tracing for each pixel, the system uses readily available 2D image data and applies computationally efficient blurring algorithms to simulate depth of field effects.
Solution Approach 2:
The patent substitutes complex optical ray tracing mechanics with a simplified computational approach using 2D projection geometry and image processing. The mechanical complexity of simulating light ray paths through 3D space is replaced by mathematical projection formulas and digital filtering operations.
2Reliability
If depth of field is simulated in real-time rendered environments, then the immersion and realism for video games is improved, but the processing time and computational resources increase
Solution Approach 1:
The patent performs depth of field preparation in advance by rendering the scene without depth of field effects and then applying 2D projection and blurring operations. This preliminary rendering approach allows the system to prepare base images that can then have depth of field applied through faster post-processing operations, rather than computing everything in real-time.
Solution Approach 2:
The patent implements dynamic depth of field adjustment by detecting viewer interactions (such as gaze direction or focus point) and adapting the blurring parameters in real-time. The system dynamically modifies which regions of the image receive blurring and to what degree, based on current viewer state, enabling responsive depth of field effects.
3Productivity
If all objects in the view are rendered with equal focus, then the rendering process is simplified and faster, but the realism and immersion is reduced
Solution Approach 1:
The patent applies different quality levels to different regions of the image by selectively blurring only those areas that are outside the viewer's focus region. The central region corresponding to the viewer's attention maintains sharp focus while peripheral regions receive varying degrees of blurring, creating realistic depth perception without uniformly processing the entire image.
Solution Approach 2:
The patent varies the blurring parameter (such as blur radius or kernel size) based on the distance of image regions from the viewer's focus point. Regions closer to the focus point use smaller blur parameters while regions farther away use larger blur parameters, creating a graduated depth effect that enhances realism.
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
A method of generating an image for display by a display device comprises deriving an expected depth of field for an image for display by the display device, with respect to a point of focus in the image, in response to lighting conditions of the environment represented by the image, such that a greater expected depth of field is associated with an image representing an environment having lighting conditions with a greater apparent brightness; and generating the image for display by the display device by applying a blurring function to simulate the expected depth of field of the image, wherein the blurring function applies blurring as a function of apparent spatial depth within the image, the blurring function being such that the degree of blurring applied to a depth region which is closer, in an apparent depth direction, to the point of focus is lower than the degree of blurring applied to a depth region which is further, in an apparent depth direction, from the point of focus, and the variation of the blurring function with respect to depth separation from the point of focus depends upon the expected depth of field.