XR Scene Description API for Object Delighting Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR technologies lack a generic solution for specifying processing models and semantics to create a generic description of delighted objects, limiting the seamless integration of virtual content into real environments.
Innovation Solution
A generic API is defined for interactions between a presentation engine and a scene understanding module, utilizing scene description files that include delighting parameters such as quality level, texture identifiers, and texture types to manage the representation of real environments in extended reality scenes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If proprietary delighting solutions are used for each engine or XR application, then the quality of virtual content integration is improved, but the device complexity and lack of generic interoperability worsen
Solution Approach 1:
The patent applies universality by creating a generic delighting processing model that can be used across different engines and XR applications. The scene description file format and delighting parameters are designed to be engine-agnostic, allowing the same framework to serve multiple purposes and platforms without requiring proprietary solutions for each application.
Solution Approach 2:
The patent uses parameter changes by introducing a quality level parameter that can be adjusted to control the extent of delighting processing. This allows the system to adapt the processing intensity based on requirements, enabling high-quality integration when needed while maintaining a standardized interface that works across different implementations.
2Manufacturing precision
If 3D artists manually model and delight objects, then the manufacturing precision of scanned assets is improved, but the loss of time and productivity worsen
Solution Approach 1:
The patent applies preliminary action by performing delighting processing automatically during the scene setup phase rather than requiring manual intervention later. The system pre-processes scanned assets using the delighting parameters specified in the scene description file, preparing them for integration before they are actually needed in the XR application.
Solution Approach 2:
The patent implements self-service by enabling the system to automatically delight scanned assets without requiring manual 3D artist intervention. The delighting processing model uses the scene description and captured images to automatically adjust lighting and integrate virtual content, allowing the system to service itself rather than relying on manual modeling.
3Manufacturing precision
If high-quality delighting processing is applied to all objects, then the quality of virtual-real content integration is improved, but the productivity and processing speed worsen
Solution Approach 1:
The patent applies local quality by allowing different quality levels to be specified for different objects or regions in the scene. The scene description file can contain delighting parameters that are applied selectively rather than uniformly to all assets, enabling high-quality processing where needed while maintaining faster processing for less critical elements.
Solution Approach 2:
The patent implements dynamics by making the delighting processing adaptive based on the quality level parameter. The system can dynamically adjust the extent of processing applied to different assets, allowing the processing intensity to vary according to requirements rather than applying a fixed high-quality treatment to everything.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An extended reality system is proposed comprising a presentation engine and a scene understanding module configured to manage representation of the real part of the scene in a generic way. The presentation engine initializes the scene understanding module with the scene description that comprises data describing parameters to integrate the real scene and the virtual part of the extended reality scene. Some objects of the scene are delighted, and the scene description comprises corresponding parameters. The scene understanding module manages a scene understanding representation thanks to data obtained from sensors or databases and warns the presentation engine of updates of the scene understanding representation.