Mixed Reality Shadow Projection via Synchronized Light Projector
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality (MR) technologies fail to create realistic shadows for virtual objects, as existing methods using additive displays do not effectively darken the real world and often display shadows inaccurately, detracting from the MR experience.
Innovation Solution
A method and system that utilize a light projection device to generate shadows in the real world corresponding to virtual objects displayed on MR systems, synchronizing the projection with the MR display to create realistic shadows based on the virtual object's position and movement, using a projector to project shadows on physical surfaces in the environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If additive displays are used to create shadows for virtual objects, then the shadow creation process is simple, but the shadows are displayed inaccurately and do not effectively darken the real world
Solution Approach 1:
The patent replaces additive display mechanisms with a digital light processing (DLP) projector system that uses digital micromirror devices to precisely control light reflection. This substitution enables accurate shadow projection by digitally manipulating light paths rather than relying on physical additive display methods, thereby achieving both ease of implementation and high shadow accuracy.
Solution Approach 2:
The system dynamically adjusts light intensity parameters to create realistic shadows. By controlling the brightness and darkness levels of projected light, the system can accurately represent shadow regions with varying intensities, effectively darkening areas where virtual objects should cast shadows while maintaining overall scene visibility.
2Measurement precision
If a projector display system is added to create accurate shadows, then shadow realism is improved, but the system complexity increases
Solution Approach 1:
The patent combines the MR display system and projector display system into a unified synchronized presentation system. Both systems share common scene data and are coordinated through a timing system, merging their functions to create a cohesive mixed reality experience with realistic shadows without requiring completely separate independent systems.
Solution Approach 2:
The DLP projector system serves multiple functions: it projects the virtual environment, creates shadows for virtual objects, and synchronizes with the MR display system. This multi-functionality reduces the need for additional specialized equipment, thereby managing system complexity while achieving accurate shadow projection.
3Reliability
If shadows are synchronized with virtual object movement, then the immersive experience is improved, but the synchronization requirements increase system complexity
Solution Approach 1:
The system implements feedback mechanisms where the position and movement of virtual objects are continuously tracked, and this information is used to dynamically adjust shadow positions in real-time. The synchronization system receives feedback from both the MR display system and projector, coordinating their output to maintain consistent shadow-virtual object relationships as objects move within the scene.
Solution Approach 2:
The system pre-synchronizes scene presentation between the MR display and projector before virtual objects begin moving. By establishing the baseline synchronized state in advance and using predetermined timing relationships, the system reduces the complexity of real-time synchronization adjustments needed during object movement, maintaining immersive experience while managing system complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the realism of virtual objects in MR experiences by creating accurate and synchronized shadows that follow the movement of virtual objects, improving the overall MR experience by providing a more immersive and aesthetically pleasing environment.
Implementation Method 1
a projector of the projector display system creates a shadow on a surface in the physical environment
Data Source
AI summary
Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.