Split Rendering With UE Pose Prediction for Low-Latency XR Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing split rendering technologies face challenges in accurately estimating the pose of user equipment (UE) for computing capability allocation between UE and server, leading to discrepancies between estimated and actual display times, which can result in degraded content quality and user discomfort.
Innovation Solution
A method and apparatus for split rendering that involves UE estimating its pose at a target display time, transmitting this information to a server, receiving and correcting the rendered result based on actual pose metadata, and displaying the corrected media frame, while defining components and measuring times for each stage of the process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the UE transmits pose information to the server for rendering, then the content quality is improved, but the latency increases due to the round-trip communication time
Solution Approach 1:
The UE estimates its future pose at the target display time before actually reaching that time, and transmits this predicted pose information to the server in advance. This preliminary action allows the server to begin rendering operations earlier, reducing the overall latency while maintaining content quality.
Solution Approach 2:
The system dynamically adjusts the pose estimation strategy based on the timing relationship between current time and target display time. When the current time is before the target display time, the UE performs predictive pose estimation to optimize the balance between content quality and latency.
2Manufacturing precision
If the UE waits for the server to render and return the media frame, then the content accuracy is improved, but the display timing precision deteriorates
Solution Approach 1:
The UE performs pose estimation at a time before the target display time, allowing the server to receive the pose information and complete rendering by the target display time. This preliminary estimation ensures both content accuracy and display timing precision are maintained.
Solution Approach 2:
The system uses feedback from the timing relationship between current time, target display time, and server processing time to optimize the pose estimation strategy. The UE adjusts when to perform estimation based on feedback about rendering performance and timing requirements.
Data Source
AI summary
The disclosure relates to a 5th generation (5G) or 6th generation (6G) communication system for supporting higher data transmission rates. A method by a user equipment (UE) supporting UE estimation-based split rendering is provided. The method includes estimating, at a first time point, a pose of the UE of a second time point indicating a target display time for a first media frame, transmitting the first media frame and first pose information related to the estimated pose to a server, receiving a second media frame, generated by rendering based on the first media frame and the estimated pose, and second pose information associated with the second media frame from the server, and displaying a third media frame at a third time point based on the second media frame and the second pose information.