Split Rendering State Synchronization for Consistent 5G XR Sessions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current split rendering technologies in 3GPP networks lack effective mechanisms for real-time synchronization of state machines, leading to fractured application states and deteriorated user experience in immersive applications like virtual and augmented reality.
Innovation Solution
Implement a method for synchronizing state transitions between a split rendering server (SRS) and client(s) (SRC) using state synchronization messages, leveraging 5G network capabilities and standardized protocols like WebRTC and RTP extensions, to ensure seamless state updates across multiple devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If split rendering is implemented to offload rendering workload to a server, then device resource constraints are relieved and high quality XR experiences become feasible on mobile devices, but real-time state synchronization between client and server deteriorates leading to fractured application states
Solution Approach 1:
The patent implements state synchronization by having the client periodically query the server for updated state information through feedback mechanisms. The server responds with current state data, enabling the client to maintain accurate local state representation despite the distributed rendering architecture. This feedback loop resolves the contradiction by ensuring state consistency without requiring continuous heavy computation on the device.
Solution Approach 2:
The patent performs preliminary state synchronization at key decision points in the rendering pipeline, such as before and after state machine transitions. By proactively synchronizing state at these critical moments rather than continuously, the system maintains reliability while reducing the frequency of synchronization operations, thus balancing state consistency with device resource consumption.
2Reliability
If state synchronization is performed frequently to maintain application state consistency, then user experience quality improves, but network bandwidth consumption and processing overhead increase
Solution Approach 1:
The patent implements periodic state synchronization at strategically determined intervals rather than continuous synchronization. The client synchronizes state before and after significant events like state machine transitions, and at periodic intervals thereafter. This periodic approach maintains application state consistency while minimizing the frequency of network communications and processing operations, thereby reducing overall energy consumption.
Solution Approach 2:
The patent uses selective copying of only the necessary state information rather than transferring complete state representations. When synchronization is needed, the system copies only the essential state data required for maintaining consistency, reducing the volume of data transmitted over the network and processed by the device, thus lowering energy consumption while preserving state accuracy.
Data Source
Figure 1A~1B
Figure 2
Figure 3a~4
AI summary
A method of synchronising the state between a spilt rendering server (SRS) in a 3GPP (5G) network and one or more split rendering clients (SRCs) each executing a graphics application. The method has the steps of establishing a split rendering session including provisioning of split rendering resources in the network; acquiring application information by an SRC from an (authorized) Application Provider (AP); exchanging scene information between the AP, SRC and SRS; configuring the split rendering session; negotiating meta-data, rendered media and associated formats between the SRS and SRC; and establishing media and meta-data transport channels. The method further includes negotiating synchronisation states between the SRS and each SRC; sending, by the SRC of rendering metadata to the SRS; sending, by the SRC of state synchronization information to the SRS; sending, from the SRS to the SRC, rendered media based at least partially on the rendering meta-data; and sending state synchronization information from the SRS to the SRC.