Virtual Object Rendering Across Uneven Lighting Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
AR/MR systems struggle to seamlessly integrate virtual objects with uneven lighting environments, leading to inconsistencies when users move between different lighting conditions, as current methods require users to repeatedly scan the environment to update lighting information.
Innovation Solution
A method for dividing an environment into multiple 3D regions, determining lighting information for each region, and using a combination of lighting information from adjacent regions to render virtual objects consistently, ensuring they align with the current lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the AR system collects lighting information by guiding the user to look around the entire scene, then the lighting information coverage is improved, but the user operation complexity increases and time consumption increases
Solution Approach 1:
The system performs self-service by automatically capturing lighting information from the current field of view without requiring user guidance. The camera continuously captures images and the system automatically processes them to extract lighting information, eliminating the need for users to manually guide the capture process.
Solution Approach 2:
The system performs preliminary action by pre-dividing the environment into multiple 3D regions and pre-capturing lighting information for each region. This allows the lighting information to be ready in advance, eliminating the need for real-time user guidance during virtual object rendering.
2Loss of time
If the user looks around once to capture lighting information, then the operation time is reduced, but the lighting information completeness deteriorates in uneven lighting environments
Solution Approach 1:
The system segments the environment into multiple 3D regions based on spatial coordinates. Each region is independently processed to capture its specific lighting characteristics, allowing comprehensive lighting information collection without requiring the user to scan the entire environment repeatedly.
Solution Approach 2:
The system applies local quality by determining lighting information specific to each 3D region rather than using a single global lighting set. This ensures that each region's unique lighting characteristics (such as brighter or darker areas) are accurately captured and applied to virtual objects within that region.
3Device complexity
If lighting information is captured from a single position, then the capture process is simplified, but the lighting information accuracy deteriorates when the user moves to different regions
Solution Approach 1:
The capture process is segmented by dividing the environment into multiple 3D regions, each with its own lighting information. This maintains simplicity in the capture process (one image per region) while improving accuracy by ensuring each region has dedicated lighting data.
Solution Approach 2:
The system transitions from a single-point lighting capture approach to a multi-dimensional regional approach. By adding the spatial dimension of region division, the system captures lighting information across different spatial locations, improving accuracy without significantly increasing complexity.
4Device complexity
If the system uses lighting information from one region for all regions, then the processing complexity is reduced, but the visual consistency deteriorates when users move between lighting regions
Solution Approach 1:
The system applies local quality by assigning different lighting information to different 3D regions based on their specific lighting characteristics. When a user moves to a different region, the system switches to the lighting information corresponding to that region, maintaining visual consistency without requiring complex real-time adjustments.
Solution Approach 2:
The system implements dynamics by dynamically switching between different lighting information sets based on the user's current region. The lighting information is not static but adapts to the user's position, ensuring visual consistency as the user moves between regions with different lighting conditions.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
The embodiments of the disclosure provide a method for rendering a virtual object, a host, and a computer readable storage medium. The method includes: determining a plurality of regions in an environment; determining lighting information of each of the plurality of regions; obtaining a to-be-rendered virtual object and selecting at least one candidate region corresponding to the to-be-rendered virtual object among the plurality of regions; determining a reference lighting information based on the lighting information of each of the at least one candidate region; and rendering the to-be-rendered virtual object based on the reference lighting information.