Virtual Ray Tracing for Dynamic Light Field Refocusing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current ray tracing algorithms are complex and unable to dynamically refocus images according to the human eye's gazing direction, limiting the visual experience in virtual reality by only allowing full focus or fixed focal planes, which does not align with the human eye's natural focusing abilities.
Innovation Solution
A virtual ray tracing method and dynamic light field refocusing system that reduces algorithm complexity through random ray sampling and simplified cross-point search, using a virtual reality content processor, eyeball tracker, and light field refocusing processor to dynamically adjust focus based on the eye's movement, allowing multiple focal planes to be viewed along the gazing direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional ray tracing algorithm is used to render images, then high quality realistic images can be generated, but the algorithm complexity is high and computational cost is large
Solution Approach 1:
The patent inverts the traditional ray tracing approach by using reverse ray tracing. Instead of tracing rays from the camera through the scene to generate images, the method traces rays from the image plane back through the scene to retrieve depth and color information. This inversion enables dynamic refocusing by allowing rays to be traced from different focal planes back to the image, achieving both high image quality and reduced computational complexity through the reversed tracing direction.
Solution Approach 2:
The patent performs preliminary rendering of the scene at a reference focal plane to generate a pre-computed image and depth map. This preliminary action stores essential scene information (color and depth) that can be reused for dynamic refocusing at different focal planes. By preparing the scene data in advance at one focal plane, the system avoids the need to re-render the entire scene for each desired focal plane, significantly reducing computational complexity while maintaining image quality.
2Adaptability or versatility
If current virtual reality devices display full focus images, then the display is simple, but the device cannot dynamically refocus according to human eye gazing direction
Solution Approach 1:
The patent implements dynamic refocusing capability by allowing the system to switch between different focal planes in real-time based on user gaze direction. The reverse ray tracing algorithm enables the system to dynamically adjust the focal plane and retrieve corresponding scene information without requiring complex hardware changes. This dynamic adaptability is achieved through software-based focal plane switching, making the system versatile while controlling complexity.
Solution Approach 2:
The system incorporates feedback from eye tracking or gaze detection to dynamically adjust the focal plane. By monitoring user gaze direction and feeding this information back to the rendering system, the device can automatically refocus the display at the appropriate depth plane. This feedback mechanism enables adaptive refocusing that matches human visual behavior, enhancing versatility while managing system complexity through intelligent control.
3Measurement precision
If dense sampling of rays is performed to collect light field information, then accurate refocusing can be achieved, but the algorithm complexity and processing time increase significantly
Solution Approach 1:
The patent applies partial sampling by tracing a subset of rays rather than all possible rays through the scene. By strategically selecting and tracing only the necessary rays (e.g., through key points or using pre-computed depth information to guide sampling), the system achieves sufficient refocusing accuracy without the computational burden of dense sampling. This partial action approach reduces processing time while maintaining the precision needed for accurate dynamic refocusing.
Data Source
AI summary
The present invention relates to a virtual ray tracing method and dynamic light field refocusing display system, ray information collection, or random retrieval for pixels on a full focus image, so as to reduce ray collection total; and/or simplifying cross point retrieval where an object surface is regarded smooth. The system includes a virtual reality content processor, a virtual reality monitor, an eyeball tracker, an eyeball tracing processor, and a ray refocusing processor. The present invention reduces computational complexity, enables automatic replacement of erroneous sampling, causes to achieve real and accurate refocusing. The present invention may enable dynamic refocusing along a gazing direction of the human eye, and enable focusing by a user to objects of variable distance, to be consistent with viewing characteristics of the human eye.