AR Media Processing for Low-Latency Augmented Reality Calls
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current communication technologies lack effective integration of augmented reality (AR) into voice and video calls, which limits user experience and potential enhancements.
Innovation Solution
An AR communication method and system that integrates AR into voice and video calls using AR media processing network elements, including AR media and control network elements, to superimpose virtual objects and information onto real-world scenes, enabling real-time interaction and three-dimensional registration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If AR is integrated into voice and video calls, then user experience is improved, but system complexity increases
Solution Approach 1:
The patent introduces an AR media processing network element as an intermediary component that handles AR-specific processing tasks separately from the core communication system. This mediator architecture allows AR functionality to be integrated into voice and video calls without directly complicating the core communication infrastructure, as the AR processing is handled by a dedicated intermediate component that interfaces with both the communication system and AR resources.
Solution Approach 2:
The system is divided into distinct functional modules: the core communication system (voice/video calling), the AR media processing network element, and AR resources. This segmentation allows each component to be developed, managed, and optimized independently, reducing overall system complexity while enabling integrated AR communication functionality.
2Adaptability or versatility
If AR media processing network elements are introduced, then AR integration capability is enhanced, but network architecture complexity increases
Solution Approach 1:
The AR media processing network element is designed as a universal component that can handle multiple AR-related tasks including virtual object rendering, spatial audio processing, and gesture recognition. This multi-functional design enhances AR integration capability while avoiding the need for separate specialized components for each AR function, thereby limiting the increase in network architecture complexity.
3Loss of information
If virtual information is superimposed on real-world scenes, then information richness is improved, but processing requirements increase
Solution Approach 1:
The system performs preliminary processing of virtual information before superimposition, including pre-rendering virtual objects, pre-processing spatial audio, and pre-aligning AR content with the real-world scene. This preliminary action reduces the computational burden during real-time execution, allowing rich information display while managing processing requirements efficiently.
Data Source
Figure 1~2A
Figure 2B~2C
Figure 3~4
AI summary
An augmented reality communication method, apparatus, and system are provided, to provide an implementation in which AR is integrated into voice and video calls, thereby improving user experience. An auxiliary data channel and a media stream channel are established between a terminal device and an AR media processing network element, so that the AR is effectively integrated into the voice and video call. In addition, AR auxiliary data and a media stream have a same transmission path, so that a latency can be reduced. The AR media processing network element may be an IMS access gateway having an AR processing capability or a media resource function MRF.