Mixed Reality Scene Adaptation for Constraint-Based Virtual Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MR technologies struggle to efficiently adapt complex virtual animations to real-world environments without requiring significant storage or computing resources, often leading to geometric aberrations and semantic issues due to uncontrolled real environments.
Innovation Solution
A device that generates dynamic virtual content by transforming the representation of the real 3D scene to a virtually adapted 3D scene, fulfilling predefined scenario constraints, allowing flexible adaptation to various real-world conditions in real-time without additional resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If complex virtual animated content is created based on assumptions about real environment geometry, then immersion and realism are improved, but geometric aberrations and semantic issues occur when the real environment does not match assumptions
Solution Approach 1:
The system performs preliminary scanning and analysis of the real environment geometry before generating virtual content. By capturing the actual 3D geometry, textures, and features of the environment in advance, the system can create virtual animated content that is pre-adapted to match the real space, preventing geometric aberrations while maintaining immersion and realism.
2Manufacturing precision
If virtual animation is adapted to real environment by scanning and analyzing layout, then geometric accuracy is improved, but storage and computing resources increase significantly
Solution Approach 1:
Instead of creating multiple complete scenario variations for different environments, the system generates a single base virtual animated content and applies local geometric adaptations based on the scanned real environment. The virtual content is modified only in the specific areas where geometric mismatches occur, such as adjusting character positions or object placements locally, rather than storing multiple complete scenario versions.
3Adaptability or versatility
If multiple scenarios are provided to cover various real situations, then adaptability is improved, but storage and computing resources increase significantly
Solution Approach 1:
The system implements dynamic scenario adaptation where a single base scenario is automatically adjusted in real-time based on the characteristics of the scanned real environment. The virtual animated content dynamically modifies its geometry, positioning, and configuration to match the actual space, providing high adaptability across diverse environments without requiring multiple pre-stored scenario versions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before runtime and involving real-world constraints (23). Real-world information (22) is captured in the real 3D scene and the scenario is executed at runtime (14) in presence of the real-world constraints. When the real-world constraints are not identified (12) from the real-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out (13) before executing the scenario, so that the virtually adapted 3D scene fulfils those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of the real 3D scene.