Virtual Object Rendering With Region-Based Lighting Matching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

AR/MR systems struggle to seamlessly integrate virtual objects with real-world lighting environments, particularly in scenarios with uneven lighting, leading to inconsistent rendering of virtual objects when users move between different lighting conditions.

Innovation Solution

The method involves dividing an environment into multiple regions, determining lighting information for each region, selecting candidate regions for a to-be-rendered virtual object, and using reference lighting information to render the object, ensuring consistency with the environment's lighting conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the AR system collects lighting information through cameras by guiding the user to look around the entire scene, then the lighting information coverage is improved, but the user operation complexity increases and time consumption increases

Engineering Contradiction:

Improvelighting information coverageVSAvoiduser operation complexity

Core Design Contradiction:

Loss of informationVSEase of operation

Solution Approach 1:

The system performs lighting information collection automatically without requiring user guidance. The camera captures images at different angles autonomously, and the processor automatically determines lighting information from these images, eliminating the need for users to manually guide the camera around the scene.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system pre-collects lighting information by capturing multiple images at different angles before rendering the virtual object. This preliminary action ensures that comprehensive lighting data is available in advance, allowing the system to select appropriate lighting information without requiring real-time user guidance.

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If the user looks around the scene to update lighting information when lighting changes, then the lighting information accuracy is improved, but the time consumption increases

Engineering Contradiction:

Improvelighting information accuracyVSAvoidtime consumption

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system continuously monitors for lighting changes in the environment and automatically triggers re-capture of lighting information when changes are detected. This continuous monitoring ensures lighting information remains accurate without requiring periodic manual user intervention to look around the scene.

Inventive Principle:

Principle #20Continuity of useful action

Solution Approach 2:

The system detects lighting environment changes and uses this feedback to automatically initiate lighting information updates. When the processor detects that lighting conditions have changed, it automatically triggers the camera to capture new images and update the lighting information database without user intervention.

Inventive Principle:

Principle #23Feedback

3Device complexity

If a single capture position is used in uneven lighting environment, then the device complexity is reduced, but the lighting information completeness deteriorates

Engineering Contradiction:

Improvecapture system complexityVSAvoidlighting information completeness

Core Design Contradiction:

Device complexityVSLoss of information

Solution Approach 1:

The system segments the lighting information collection process by capturing images at multiple discrete angles (e.g., 0°, 45°, 90°, 135°, 180°, 225°, 270°, 315°). This segmentation allows comprehensive lighting coverage in uneven environments while maintaining a relatively simple camera-based capture system without requiring complex multi-position mechanisms.

Inventive Principle:

Principle #1Segmentation

4Productivity

If the AR system uses lighting information from one region for virtual objects in another region, then the rendering speed is improved, but the rendering consistency deteriorates

Engineering Contradiction:

Improverendering speedVSAvoidrendering consistency

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system divides the environment into multiple regions, each with its own captured lighting information. When rendering a virtual object, the processor selects lighting information specific to the region where the virtual object is located, ensuring that each region receives appropriately matched lighting data that reflects its actual lighting conditions.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The processor acts as an intermediary that matches virtual objects with appropriate lighting information from the correct region. It determines which region the virtual object is in and selects the corresponding lighting information from the database, ensuring consistent rendering while maintaining efficient lookup and retrieval processes.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12633066B2Method for rendering virtual object, host, and computer readable storage medium

Publication Date: 2026.05.19 HTC CORP

AI summary

The embodiments of the disclosure provide a method for rendering a virtual object, a host, and a computer readable storage medium. The method includes: determining a plurality of regions in an environment; determining lighting information of each of the plurality of regions; obtaining a to-be-rendered virtual object and selecting at least one candidate region corresponding to the to-be-rendered virtual object among the plurality of regions; determining a reference lighting information based on the lighting information of each of the at least one candidate region; and rendering the to-be-rendered virtual object based on the reference lighting information.