AR Virtual Object Shadow Rendering via Environment Light Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems fail to accurately simulate shadows for virtual objects in real-world environments, which limits the rendering quality and realism of mixed reality scenes due to performance issues with real-time environment lighting.
Innovation Solution
An electronic device equipped with a camera unit, processor, and displayer that captures and stitches images of the physical environment to calculate environment light, reflections, and shadows, enabling realistic rendering of virtual objects within the AR scene by analyzing lighting directions and generating accurate shadows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If real-time environment lighting techniques are used to simulate lighting for virtual objects, then the lighting configuration can be matched to the real-world environment, but shadows cannot be simulated due to performance issues
Solution Approach 1:
The system performs preliminary capture of environment images and pre-calculates lighting configurations, shadows, and reflections before rendering the virtual object. By preparing these lighting parameters in advance rather than calculating them in real-time during rendering, the system achieves both accurate shadow simulation and lighting matching without performance bottlenecks
Solution Approach 2:
The system captures real environment images and creates copies of the lighting conditions, shadows, and reflections present in the real world. These copied lighting parameters are then applied to the virtual object, allowing it to inherit the exact lighting configuration and shadow characteristics of the real environment without requiring complex real-time calculations
2Manufacturing precision
If shadows are simulated for virtual objects, then depth information and rendering quality are greatly improved, but performance requirements increase significantly
Solution Approach 1:
Instead of performing complex real-time shadow calculations, the system captures shadow information from environment images and copies these shadow characteristics directly to the virtual object. This approach achieves high rendering quality with shadows that provide depth information, while avoiding the excessive computational performance requirements of real-time shadow simulation
Solution Approach 2:
The system pre-calculates and stores shadow parameters by analyzing environment images before rendering. By performing the computationally intensive shadow analysis in advance and storing the results, the system achieves high rendering quality without the performance burden during the actual rendering process
Data Source
AI summary
An electronic device, method for displaying an augmented reality scene and non-transitory computer-readable medium are provided in this disclosure. The electronic device includes a camera unit, a displayer, and a processor. The processor electrically connected to the camera unit and the displayer. The camera unit is configured for capturing a plurality of images of the physical environment. The displayer is configured for displaying an AR image. The processor is configured for stitching the plurality of images to generate an environment image; calculating an environment light and a reflection of the physical environment corresponding to the virtual object according to the environment image; analyzing direction of a lighting to calculate a shadow corresponding to the virtual object according to the environment image; and rendering the virtual object on the AR image according to the environment light, the reflection, and the shadow.