XR Real-Environment Data Processing With Dynamic Task Delegation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) applications lack a mechanism to efficiently configure, capture, and transmit scanned data from user equipment (UE) to a server, particularly for seamless integration of virtual content into the real environment, which requires significant processing capacity for tasks like segmentation and labeling of 3D models.
Innovation Solution
A mechanism is proposed for managing scanned data by initializing UE to transmit data to a server, with configurations defining delegation of tasks such as 3D model extraction and segmentation, utilizing a lightweight UE that can delegate processing to a server or perform locally, and employing a generic API for scene understanding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If scanned data is transmitted from UE to server for processing, then processing capacity is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent segments the 3D model into multiple parts (e.g., by spatial regions or object instances) and transmits only the necessary segments to the server for processing. This reduces the total data量 transmitted over the network while maintaining the processing capabilities needed for scene understanding and virtual content integration.
2Speed
If 3D model extraction and segmentation are performed locally on UE, then processing speed is improved, but device complexity increases
Solution Approach 1:
The patent implements a dynamic processing architecture where the UE can flexibly choose between local processing and server-based processing based on the complexity of the task and available computational resources. The system dynamically adjusts the processing location to balance between processing speed and device complexity requirements.
3Adaptability or versatility
If configuration options for data transmission are added, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent introduces a universal configuration mechanism that handles multiple transmission modes and processing scenarios through a single standardized interface. This multi-functional configuration system improves adaptability to different network conditions and processing requirements without proportionally increasing device complexity.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
A mechanism is proposed to handle scanned data (3D Model) information from the user's real environment for extended or augmented reality applications. The mechanism relies on a configuration step. Then, the transmission of scanned data or raw data over a network from a user equipment to a server is detailed. The architecture for the user equipment may be a lightweight extended Reality (XR) UE requiring the delegation of the extraction of 3D Model of the real scene and the segmentation of this model to the server, an advanced user equipment capable of extracting 3D Model but requiring the delegation of the segmentation task to a server or a high-end user equipment capable of performing locally the extraction of the 3D model for standalone usage.