5G AR/MR Streaming With Dual-Loop Cognitive Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing call flows for delivering augmented reality (AR)/mixed reality (MR) applications in 5G networks are inefficient, particularly for devices with limited computational resources (EDGAR devices), as they lack a defined protocol for media streaming and cognitive information exchange.
Innovation Solution
A method and apparatus for establishing an AR/MR session over a 5G media streaming network, iteratively receiving and rendering AR/MR scenes, acquiring cognitive and pose information, and transmitting this information to a cognitive immersive server during content streaming, utilizing a device with both edge-dependent and stand-alone capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR/MR content is streamed to EDGAR devices with limited computational resources, then device compatibility and accessibility are improved, but processing efficiency and interaction responsiveness deteriorate due to lack of defined protocols for cognitive information exchange
Solution Approach 1:
The patent segments the AR/MR processing into two distinct loops: an inner loop for media content streaming and an outer loop for cognitive information exchange. This segmentation allows EDGAR devices to receive pre-rendered media content efficiently while separately managing cognitive data transmission to immersive servers, thereby improving both device compatibility and processing efficiency without requiring full computational capabilities locally.
Solution Approach 2:
The patent introduces a dual-loop call flow mechanism that acts as an intermediary protocol between EDGAR devices and cognitive immersive servers. This intermediary framework enables standardized cognitive information exchange for edge-dependent devices without requiring changes to the devices' limited local processing capabilities, thus resolving the contradiction between accessibility and efficiency.
2Speed
If cognitive information is continuously exchanged during media streaming, then interaction responsiveness and user experience are improved, but network bandwidth consumption and system complexity increase
Solution Approach 1:
The patent implements periodic action by structuring cognitive information exchange in discrete outer loop iterations rather than continuous streams. The device iteratively receives AR/MR scenes, renders them, acquires cognitive information, and transmits pose and cognitive data at structured intervals synchronized with media content updates. This periodic approach maintains interaction responsiveness while controlling network bandwidth consumption compared to continuous real-time exchange.
3Quantity of substance
If a dual-loop call flow mechanism is implemented for edge-dependent devices, then bandwidth efficiency is improved, but protocol complexity and implementation difficulty increase
Solution Approach 1:
The dual-loop call flow mechanism segments protocol operations into distinct inner loop (media streaming) and outer loop (cognitive exchange) sequences. The inner loop handles iterative scene reception and rendering, while the outer loop manages cognitive information acquisition and transmission to immersive servers. This segmentation organizes protocol complexity into manageable, standardized stages that improve bandwidth efficiency while making implementation systematic rather than chaotic.
Data Source
AI summary
A method for delivering a 5th generation (5G) augmented reality (AR)/mixed reality (MR) experience includes establishing an AR/MR session for streaming AR/MR media content for transmission over a 5G media streaming (5GMS) network; receiving an AR/MR media content update that is associated with a plurality of AR/MR scenes; iteratively receiving a respective AR/MR scene included in the plurality of AR/MR scenes; rendering the respective AR/MR scene; acquiring cognitive information and pose information corresponding to the respective AR/MR scene; and transmitting the cognitive information and the pose information to a cognitive immersive server while the AR/MR media content is streamed.