Light Probe Upsampling for Real-Time Mobile Global Illumination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing rendering technologies face challenges in achieving global illumination effects in real-time on mobile terminals due to high computing loads, leading to light leakage and incompatibility with low computing power devices.
Innovation Solution
A rendering method that involves obtaining texture information of a light probe, performing illumination calculation to create a resolution-reduced irradiance map, and upsampling it to match the required resolution for indirect light rendering, while using a shadow map for direct light rendering to reduce computing overheads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-performance platforms like computers or hosts are used for dynamic global illumination, then rendering quality is improved, but device complexity and cost increase
Solution Approach 1:
The patent changes the resolution parameter of the irradiance map from full rendering resolution to a reduced resolution (e.g., 1/4 or 1/9 of original resolution). This parameter change enables terminal devices with limited computing power to perform global illumination calculations in real-time while maintaining acceptable visual quality after upsampling
Solution Approach 2:
The patent creates a simplified copy of the irradiance map at reduced resolution, which serves as a proxy for the full-resolution illumination data. This copied lower-resolution map can be stored and processed efficiently on terminal devices, then upsampled when needed for rendering
2Manufacturing precision
If shading calculation is performed at original resolution, then rendering precision is improved, but computing load increases
Solution Approach 1:
The patent changes the resolution parameter during the illumination calculation phase, performing shading calculations at a reduced resolution (e.g., 256x256 or 512x512) instead of full resolution (e.g., 1024x1024 or 2048x2048). This dramatically reduces the number of pixels that require computationally intensive global illumination calculations
Solution Approach 2:
The patent introduces a resolution dimension separation, where the irradiance map is calculated at one resolution level and then transformed to another resolution level through upsampling. This separates the computationally heavy calculation phase from the display phase, allowing each to operate at optimal resolution
3Manufacturing precision
If offline baking is used for static light source scenes, then global illumination effect is improved, but adaptability to dynamic scenes deteriorates
Solution Approach 1:
The patent implements a dynamic light probe system that can be updated in real-time as objects and light sources move within the scene. Unlike static pre-baked light maps, the light probes are regenerated or updated during runtime, allowing the global illumination effect to adapt to dynamic changes while maintaining real-time performance through reduced resolution calculations
Data Source
AI summary
A rendering method is applied to a terminal device, and the method includes: obtaining texture information of a light probe in a to-be-rendered virtual scene; performing illumination calculation on the virtual scene based on the texture information of the light probe, to obtain a first irradiance map, where a resolution of the first irradiance map is less than a resolution required by a rendering result of the virtual scene; and performing upsampling on the first irradiance map, to obtain a second irradiance map, where a resolution of the second irradiance map and the resolution required by the rendering result of the virtual scene are the same, and the second irradiance map is used to perform indirect light rendering of the virtual scene.