Augmented Video Rendering With Precomputed Illumination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual reality systems are limited by video quality, which inversely correlates with user movement freedom, typically providing cinematic quality only for static viewing perspectives.
Innovation Solution
The solution involves parameterizing visible surfaces in a scene, precomputing illumination values for each texel, and identifying multiple permissible perspectives to render the scene in real-time based on the user's adopted view, enabling cinematic quality video while allowing for unconstrained movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional video rendering solutions are used to provide cinematic or high quality video, then video quality is improved, but user movement freedom deteriorates (user is constrained to static viewing perspectives)
Solution Approach 1:
The patent precomputes illumination values for each texel of visible surfaces before rendering. This preliminary computation of lighting information allows the system to quickly render high-quality video from multiple perspectives without real-time computational burden, enabling both cinematic quality and user movement freedom
Solution Approach 2:
The patent enables dynamic switching between multiple precomputed illumination values based on the user's current viewing perspective. As the user moves freely within the permissible perspective range, the system dynamically selects and applies the appropriate precomputed illumination data, maintaining high video quality while adapting to continuous user movement
2Adaptability or versatility
If multiple viewing perspectives are enabled for user freedom, then user movement freedom is improved, but video quality deteriorates (loss of cinematic quality)
Solution Approach 1:
The patent precomputes and stores illumination values for multiple possible viewing perspectives in advance. This preparation allows the system to maintain cinematic video quality across all permitted user perspectives without real-time computation, as the lighting information is already calculated and ready for immediate rendering
Solution Approach 2:
The patent changes the parameter of illumination values by precomputing them for different viewing angles and perspectives. This parameter preparation enables the system to switch between multiple perspectives while maintaining consistent high-quality rendering, as each perspective has its corresponding precomputed illumination data
3Adaptability or versatility
If real-time rendering is performed for multiple perspectives, then user movement freedom is improved, but processing time increases (perceivable latency)
Solution Approach 1:
The patent performs the computationally intensive illumination calculation in advance and stores the results. When the user moves to a different perspective, the system simply retrieves the precomputed data rather than recalculating it, eliminating processing delays and ensuring real-time responsive rendering without perceivable latency
Solution Approach 2:
The patent creates copies of illumination data for different viewing perspectives during the precomputation phase. These copied illumination values are stored and can be instantly accessed during rendering, allowing multiple perspectives to be rendered in real-time without the computational overhead of calculating lighting from scratch for each view
Data Source
AI summary
A video rendering system includes a field-of-view detector, a display, and a computing platform including a hardware processor and a memory storing a multi-viewpoint video rendering software code. The hardware processor executes the multi-viewpoint video rendering software code to parameterize visible surfaces in a scene to define multiple texels for each visible surface, precompute one or more illumination value(s) for each texel of each visible surface, and for each texel of each visible surface, store the illumination value(s) in a cache assigned to the texel. In addition, the multi-viewpoint video rendering software code receives a perspective data from the field-of-view detector identifying one of multiple permissible perspectives for viewing the scene, and renders the scene on the display in real-time with respect to receiving the perspective data, based on the identified perspective and using one or more of the illumination value(s) precomputed for each texel of each visible surface.