XR Scene Composition Across Environments Using Spatial Constraints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in efficiently composing and presenting scenes in extended reality (XR) environments that accurately reflect various physical environments, requiring extensive user input to define spatial relationships and constraints for virtual assets.
Innovation Solution
A graphical user interface (GUI) is developed to facilitate composing scenes by allowing users to add virtual and anchor assets, define constraints, and preview scenes in different environments, with the system adjusting definitions based on user feedback to ensure predictable and pleasurable user experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If users manually define spatial relationships and constraints for virtual assets in XR environments, then scene composition accuracy is improved, but user time and effort increase significantly
Solution Approach 1:
The system automatically performs scene composition by detecting physical objects in the environment and autonomously placing virtual assets with appropriate spatial relationships and constraints, eliminating the need for manual user configuration while maintaining high composition accuracy
Solution Approach 2:
The patent replaces manual mechanical interaction (drag-and-drop, constraint definition) with automated computer vision-based object detection and AI-driven scene composition algorithms that automatically understand and establish spatial relationships
2Adaptability or versatility
If the system supports diverse physical environments with varying objects, then adaptability is improved, but system complexity increases
Solution Approach 1:
The system employs a universal object detection and classification framework that can identify and handle multiple types of physical objects across diverse environments using the same core algorithms, allowing the system to adapt to various environments without requiring environment-specific configuration
Solution Approach 2:
The system dynamically adjusts scene composition parameters such as virtual asset placement, scaling, and orientation based on detected environmental parameters including object types, spatial arrangements, and environmental characteristics, enabling automatic adaptation to diverse physical settings
Data Source
AI summary
In one implementation, a method of presenting a scene content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes generating a definition of a scene based on a model of an environment, wherein the definition includes a constraint that defines a spatial relationship between a first asset and a second asset that corresponds to one or more objects in the environment. The method includes generating, based on application of the definition of the scene to first and second environments, first and second instances of the scene that satisfy the constraint with the first asset in the spatial relationship with a first one and a second one of the one or more objects in the first and second environments, respectively. The method includes presenting, on the display, the first and second instances of the scene.