3D Display System Integrating Real-World Lighting via Light Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D display systems disconnect real-world physical conditions from virtual imagery, leading to a lack of realism and immersion, as virtual lighting conditions are not integrated with actual environmental lighting.
Innovation Solution
A system that captures real-world lighting conditions using cameras and incorporates them into virtual 3D scenes through light maps, sparse light fields, and depth maps, allowing for dynamic integration of physical lighting into virtual environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If conventional 3D display systems use separate virtual lighting conditions independent of real-world environment, then device complexity is reduced and ease of manufacture is improved, but realism and immersion of the virtual imagery deteriorate
Solution Approach 1:
The patent merges real-world lighting conditions captured by cameras with virtual lighting conditions in the 3D display system. The system combines data from multiple cameras that capture images of the real environment with the virtual scene rendering, integrating physical lighting information into the virtual imagery to enhance realism while maintaining a unified display output.
Solution Approach 2:
The patent introduces intermediary components including cameras to capture real-world lighting, processors to analyze and integrate the captured images with virtual scene data, and light maps to transfer lighting information from the real environment to the virtual display. These intermediaries bridge the gap between physical and virtual lighting conditions.
2Illumination intensity
If conventional 3D display systems use static virtual lighting conditions, then processing time is reduced and productivity is improved, but immersion and dynamic responsiveness deteriorate
Solution Approach 1:
The patent implements periodic capture and processing of real-world lighting conditions through cameras at regular intervals, updating the virtual scene lighting dynamically. This periodic action allows the system to respond to changes in the real environment while maintaining a manageable processing rhythm that balances immersion with processing time constraints.
Solution Approach 2:
The system performs preliminary capture of real-world lighting conditions and pre-processes the imagery data before integrating it with the virtual scene. By preparing lighting information in advance through camera capture and initial processing, the system reduces the computational burden during real-time rendering, thereby maintaining immersion while managing processing time.
Data Source
AI summary
Systems and methods for incorporating real world conditions into a three-dimensional (3D) graphics object are described herein. In some embodiments, images of a physical location of a user of a three-dimensional (3D) display system may be received from at least one camera and a data imagery map of the physical location may be determined based at least in part on the received images. The data imagery map may capture real world conditions associated with the physical location of the user. Instructions to render a 3D graphics object may be generated and the data imagery map may be incorporated into a virtual 3D scene comprising the 3D graphics object, thereby incorporating the real world conditions into virtual world imagery. In some embodiments, the data imagery may include a light map, a sparse light field, and/or a depth map of the physical location.