Wearable Mixed Reality Rendering with Dynamic Lighting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional wearable computing devices render virtual objects using fixed lighting conditions, failing to account for real-world lighting environments, which limits user experience by not simulating the impact of varying environmental lighting.
Innovation Solution
A method and device for wearable computing devices that acquire environment lighting information, including light intensities in multiple directions, to render objects more accurately and realistically, enhancing user interaction by applying these lighting factors to the rendering process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If fixed lighting conditions are used for rendering virtual objects, then rendering consistency is maintained, but rendering realism deteriorates because real-world lighting variations are not reflected
Solution Approach 1:
The wearable computing device uses its own camera to capture images of the real-world environment and automatically extracts lighting information from these images. The system serves itself by using its built-in sensing capabilities (camera) to gather the necessary lighting data without requiring external lighting measurement devices, thereby improving lighting accuracy while avoiding additional device complexity
Solution Approach 2:
The system dynamically changes the lighting parameters used for rendering virtual objects based on the actual real-world environment. By extracting lighting information (such as light direction, intensity, and color temperature) from captured images and adjusting rendering parameters accordingly, the system achieves realistic lighting adaptation without complex hardware modifications
2Measurement precision
If predefined lighting conditions are applied to all rendered objects, then rendering processing simplicity is maintained, but rendering accuracy deteriorates because environmental lighting variations are ignored
Solution Approach 1:
The system performs preliminary lighting analysis by capturing images of the real-world environment and extracting lighting information before rendering virtual objects. By pre-processing the lighting data from the camera images (such as determining light sources, directions, and intensities), the system prepares accurate lighting conditions in advance, improving measurement precision while reducing the time needed during the actual rendering process
Solution Approach 2:
The system extracts only the essential lighting information (such as light source positions, directions, and intensities) from the captured environment images, separating the critical lighting parameters from the rest of the image data. This extraction approach achieves high measurement precision by focusing on key lighting attributes while minimizing processing time by ignoring non-essential image details
Data Source
Figure 1~2
Figure 3~4
Figure 5A~6B
AI summary
Implementations of the subject matter described herein relate to mixed reality rendering of objects. According to the embodiments of the subject matter described herein, while rendering an object, a wearable computing device takes lighting conditions in the real world into account, thereby increasing the reality of the rendered object. In particular, the wearable computing device acquires environment lighting information of an object to be rendered and renders the object to a user based on the environment lighting information. In this way, the object rendered by the wearable computing device can be more real and accurate. The user will thus have a better interaction experience.