Dynamic Lighting Reproduction for 3D Models Using Environmental Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented and virtual reality technologies fail to accurately represent lighting conditions in real-world environments, leading to unrealistic renderings of digital 3D models due to fixed luminosity settings, which do not account for actual lighting conditions.
Innovation Solution
A display apparatus and method that utilizes an image sensor and control circuitry to capture 360° images of the environment, detect light sources, and reproduce lighting conditions on digital 3D models based on determined lighting parameters, including intensity, position, and color, ensuring accurate and dynamic representation of reflections and shadows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If fixed luminous intensity is preset for 3D model rendering, then rendering process is simple and fast, but lighting accuracy and realism deteriorate
Solution Approach 1:
The patent implements dynamic lighting adjustment by capturing real-time environmental lighting conditions using image sensors and adjusting the rendering lighting parameters accordingly. The system transitions from static preset lighting to dynamic lighting that adapts to actual environmental conditions, achieving both accuracy and responsiveness
Solution Approach 2:
The patent employs feedback mechanisms where image sensors continuously monitor environmental lighting conditions and feed this information back to the rendering system. This closed-loop feedback enables the system to automatically adjust lighting parameters to match real-world conditions, resolving the contradiction between rendering speed and lighting accuracy
2Device complexity
If preset lighting conditions are used for 3D model rendering, then device complexity is reduced, but adaptability to real environment deteriorates
Solution Approach 1:
The patent makes the lighting system universal by integrating image sensors, processing units, and rendering engines that can adapt to various environmental lighting conditions. The system performs multiple functions: capturing environmental light, processing lighting data, and dynamically adjusting rendering parameters, thereby achieving high adaptability without proportionally increasing complexity
Solution Approach 2:
The lighting system serves itself by automatically capturing, processing, and adjusting lighting parameters without manual intervention. The image sensors autonomously monitor environmental conditions and the processing unit automatically generates appropriate lighting settings, reducing the need for complex manual control systems while enhancing environmental adaptability
3Reliability
If static lighting representation is used on 3D model, then rendering performance is maintained, but visual realism deteriorates
Solution Approach 1:
The patent transforms static lighting representation into dynamic lighting that responds to real-time environmental changes. By continuously updating lighting parameters based on captured environmental data, the system maintains rendering performance while significantly enhancing visual realism through dynamic adaptation to actual lighting conditions
Data Source
AI summary
A display apparatus comprises an image sensor and a control circuitry. The image sensor captures a 360° image of a real-world environment and the control circuitry detects at least one light source in the captured 360° image and determines a plurality of lighting parameters of the detected light source. A lighting condition caused by the light source in the real-world environment is reproduced on a three-dimensional (3D) model based on the determined plurality of lighting parameters. The 3D model along with 360° media content that includes at least the captured 360° image is rendered at the display apparatus such that the reproduced light condition is visible on the rendered 3D model. A minimum deviation is exhibited in representation of a light reflection caused by the light source on the rendered 3D model during visualization of the 3D model at the display apparatus in presence of the light source.