XR Scene Composition Using Physical-Object Spatial Constraints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in efficiently composing and presenting scenes in extended reality (XR) environments that account for the spatial relationships between virtual and physical objects, requiring extensive user input and imagination to ensure a predictable and pleasurable user experience.
Innovation Solution
A graphical user interface (GUI) is developed to facilitate the composition of scenes by allowing users to define spatial relationships between virtual assets and anchor assets corresponding to physical objects, with features for previewing and adjusting scene definitions based on user feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a scene definition includes constraints defining spatial relationships between virtual assets and anchor assets, then the scene can be adapted to different physical environments, but the complexity of composing and executing the scene increases
Solution Approach 1:
The scene definition is segmented into distinct components: anchor assets representing physical objects, virtual assets representing virtual content, and constraints defining spatial relationships between them. This segmentation allows the system to handle complex spatial reasoning by breaking it down into manageable asset-constraint pairs that can be independently processed and composed.
Solution Approach 2:
The system dynamically adapts scene composition based on the detected physical environment. Constraints are evaluated against actual physical objects in the environment, and scene instances are generated dynamically to satisfy these constraints. This dynamic approach enables the same scene definition to work across different physical environments without manual reconfiguration.
2Reliability
If the system generates scene instances that satisfy spatial constraints in different physical environments, then user experience becomes predictable and pleasurable, but the processing time and computational resources increase
Solution Approach 1:
The scene definition is prepared in advance with all spatial constraints explicitly defined before execution. Anchor assets and their expected spatial relationships are pre-specified in the scene definition, allowing the system to quickly match these pre-defined constraints against the detected physical environment during runtime without performing complex computations from scratch.
Solution Approach 2:
The system creates instances of the scene by copying and instantiating the pre-defined scene definition for different physical environments. Rather than re-composing the scene each time, the system copies the validated scene definition and adapts it to match the specific anchor assets detected in the current environment, significantly reducing processing time while maintaining consistency.
Data Source
AI summary
In one implementation, a method of composing a scene content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes generating a definition of a scene based on textual or speech input and a model of a physical environment, wherein the definition includes a constraint that defines a spatial relationship between a virtual asset and an anchor asset that corresponds to one or more physical objects in the physical environment. The method includes generating, based on the definition of the scene and the model of the physical environment, a first instance of the scene that satisfies the constraint with the virtual asset in the spatial relationship with a first one of the one or more physical objects in the physical environment. The method includes presenting, on the display, the first instance of the scene.