AR Client Capability Signaling for Edge-Split Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing digital video devices struggle with efficient rendering of augmented reality (AR) media data, particularly when client devices have varying degrees of AR capability, leading to excessive power and processing demands on AR glasses or user equipment (UE) devices.
Innovation Solution
Implementing split rendering techniques where an edge application server performs part of the rendering process, streaming rendered images to AR glasses or head-mounted displays, and utilizing pose correction to ensure accurate image display based on user pose information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If full AR rendering is performed on client devices, then rendering quality is improved, but power consumption and processing demands increase excessively
Solution Approach 1:
The rendering process is divided into two segments: complex 3D scene rendering is performed on the edge server, while only the final rendered images are transmitted to and displayed on the AR glasses. This segmentation transfers computational workload from the power-constrained wearable device to the more powerful edge infrastructure, maintaining rendering quality while reducing local power consumption.
Solution Approach 2:
The edge server acts as an intermediary between the AR content source and the AR glasses display. It receives raw AR media data, performs computationally intensive rendering operations, and streams the processed visual output to the glasses. This intermediary approach allows high-quality rendering without directly burdening the power-constrained wearable device.
2Manufacturing precision
If advanced rendering techniques are used on edge servers, then rendering quality is improved, but device complexity increases
Solution Approach 1:
The edge server serves as a centralized intermediary that handles all complex rendering operations. This approach consolidates system complexity into a dedicated infrastructure component rather than distributing it across multiple client devices. The AR glasses remain relatively simple, focusing only on receiving and displaying pre-rendered images, while the edge server absorbs the computational complexity.
3Adaptability or versatility
If AR media data is processed on client devices with varying capabilities, then adaptability is improved, but processing efficiency decreases
Solution Approach 1:
The edge server acts as a universal intermediary that handles AR processing for devices with varying capabilities. Instead of each client device independently processing AR data according to its own limited capabilities, the edge server provides centralized processing that optimizes efficiency. The system maintains adaptability by serving different device types (fully capable, partially capable, or incapable devices) through a single unified processing architecture.
Data Source
AI summary
An example first client device for communicating media data via a radio access network (RAN) includes: a memory configured to store AR media data; and a processing system implemented in circuitry and configured to: send data to a network device of the RAN, the data indicating an amount of support for AR processing provided by the first client device; establish an AR communication session with a second client device; and exchange AR media data with the second client device according to the amount of support for AR processing provided by the first client device.