AR Split-Rendering Capability Signaling to Reduce Network Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current specifications for split rendering in 5G augmented reality devices do not define how often and with what increments view position information should be captured and sent to the network, leading to network and server computational overheads.
Innovation Solution
A method and apparatus that determine the capabilities of an augmented reality device as a split rendering client, obtain and process media data based on these capabilities, and signal them to a split rendering server for optimized split rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the device sends detailed capability information and view position information to the network, then the split rendering quality and adaptability are improved, but the network overhead and server computational overhead increase
Solution Approach 1:
The device performs capability self-assessment and determines suitable view position information in advance before sending to the network. This preliminary determination reduces the need for extensive back-and-forth negotiation and minimizes network overhead while ensuring the device receives appropriately configured rendering services.
Solution Approach 2:
The patent changes the parameter representation by introducing a capability level indicator that summarizes multiple capability parameters into a single negotiated parameter. This allows the network to adapt rendering configurations based on the capability level without requiring detailed parameter exchanges, thereby reducing network overhead while maintaining adaptability.
2Adaptability or versatility
If the device sends detailed capability information and view position information to the network, then the split rendering quality and adaptability are improved, but the server computational overhead increases
Solution Approach 1:
The server receives pre-determined capability information and view position data from the device, allowing it to prepare rendering configurations in advance without intensive real-time computation. This shifts computational work to the device side, reducing server computational overhead while maintaining rendering quality.
Solution Approach 2:
By negotiating capability levels rather than processing detailed capability parameters, the server reduces its computational burden. The capability level parameter enables the server to select appropriate rendering configurations from pre-defined sets, minimizing real-time computational overhead while preserving adaptability to different device capabilities.
3Use of energy by moving object
If the device runs lighter processes with split rendering, then device resource consumption is reduced, but the network and server must handle more processing
Solution Approach 1:
The device determines its capability level and suitable view position information in advance, enabling the network to prepare optimized rendering streams that match device capabilities. This preliminary preparation allows the network to efficiently allocate processing resources without excessive overhead, balancing device energy savings with network processing requirements.
Solution Approach 2:
The capability level parameter enables the network to adjust rendering processing intensity based on device capabilities. Devices with lower processing power receive pre-rendered content at appropriate quality levels, while more capable devices receive higher quality streams, optimizing the balance between device energy consumption and network processing power.
Data Source
AI summary
A method and apparatus comprising computer code configured to cause a processor or processors to determine capabilities of an augmented reality (AR) device, the capabilities indicating, as part of the AR device serving as a split rendering client (SRC), any of an audio encoder or decoder of the AR device and a video encoder or decoder of the AR device; obtain AR data of a media component of at least one of audio and video based on a request signaling the capabilities of the AR device to a server, acting as a split rendering server (SRS) for split rendering of the media component between the SRS and the SRC, providing the AR data; and process the AR data based on the capabilities of the AR device signaled to the SRC.