Split Rendering for AR Latency in 5G IoT Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In 5G communication systems, there is a performance difference between content processing devices and devices in communication systems, leading to challenges in rendering augmented reality (AR) content efficiently, particularly due to latency and immersion issues caused by discrepancies in user motion and virtual object representation.
Innovation Solution
A method and device that involve a first electronic device measuring user pose information, including location and gazing direction, and transmitting this data to a second electronic device, which predicts and generates an AR image, allowing for split rendering between the devices to reduce latency and improve immersion by using prediction models and reprojection techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If AR content is rendered in real-time on the user's device, then immersion and responsiveness are improved, but processing complexity and power consumption increase
Solution Approach 1:
The rendering process is divided into two segments: complex rendering operations are performed on a server, while simpler display and composition tasks are handled on the user's device. This segmentation allows high-quality AR rendering without overburdening the user device's processing capabilities.
Solution Approach 2:
A server acts as an intermediary between the content source and the user device. The server performs complex AR content rendering and prepares optimized content for transmission, mediating between high-fidelity rendering requirements and limited user device capabilities.
2Productivity
If AR content is pre-rendered and transmitted to devices, then processing load on user devices is reduced, but latency increases due to transmission time
Solution Approach 1:
AR content is pre-rendered and prepared on the server before transmission to user devices. This preliminary action completes computationally intensive tasks in advance, reducing the processing burden on user devices and enabling faster local display despite network transmission requirements.
3Measurement precision
If user pose measurement frequency is increased, then AR content accuracy is improved, but data transmission volume and processing load increase
Solution Approach 1:
Different levels of measurement precision are applied based on local requirements. The system measures user pose information at appropriate frequencies and detail levels for each specific application context, transmitting only the necessary data volume required for maintaining AR content accuracy without excessive overhead.
Data Source
AI summary
The present disclosure relates to a communication method and system for converging a 5th-Generation (5G) communication system for supporting higher data rates beyond a 4th-Generation (4G) system with a technology for Internet of Things (IoT). According to the present disclosure, a method performed by a first electronic device displaying AR content comprises obtaining measurement time information about a time when a user's pose is measured and measurement pose information about the measured pose, generating a first report including the measurement time information and the measurement pose information, transmitting the first report to a second electronic device, receiving a predicted image for a target point generated by the second electronic device, and displaying an AR image at the target point based on the predicted image.