Mobile Edge Device XR Rendering Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current extended reality (XR) rendering technologies face challenges in reducing latency and bandwidth usage, particularly in providing seamless XR experiences for local user devices, as they often rely on remote servers for content delivery, leading to increased latency and bandwidth consumption.

Innovation Solution

Implementing a method where a mobile edge device receives and processes XR content locally, using a portion of pre-received frames to generate and update XR renderings based on user position data within a specific viewing angle, reducing the need for frequent requests to remote applications and minimizing latency and bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If XR content is delivered from remote servers to local devices, then comprehensive XR experiences can be provided, but latency increases and bandwidth consumption increases

Engineering Contradiction:
ImproveXR experience qualityVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system segments XR content delivery into two parts: initial content delivery from remote servers, and subsequent local rendering updates at the edge device. This segmentation allows the system to maintain comprehensive XR experience quality while reducing latency for position-based rendering updates by handling them locally rather than through repeated remote server communication.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an edge device as an intermediary between remote servers and local XR devices. This intermediary receives initial XR content from remote servers, then performs local rendering updates based on device position changes, reducing the need for continuous communication with remote servers and thereby reducing latency and bandwidth consumption.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If XR content is delivered from remote servers to local devices, then comprehensive XR experiences can be provided, but bandwidth usage increases

Engineering Contradiction:
ImproveXR experience qualityVSAvoidbandwidth usage
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system segments bandwidth usage into an initial content delivery phase from remote servers and subsequent local rendering phases at the edge device. By performing position-based rendering updates locally, the system significantly reduces ongoing bandwidth consumption while maintaining comprehensive XR experience quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The edge device acts as an intermediary that receives initial XR content from remote servers via telecommunications networks, then performs local rendering updates using position data from sensors. This intermediary function reduces bandwidth usage by eliminating the need for continuous remote server communication for each position update.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of time

If local edge device performs XR rendering, then latency is reduced, but device complexity increases

Engineering Contradiction:
ImprovelatencyVSAvoidedge device complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The edge device performs preliminary actions by receiving and storing initial XR content (plurality of frames) from remote servers before local rendering begins. This preliminary action allows the device to subsequently perform fast local rendering updates without needing to repeatedly access remote servers, thereby reducing latency while managing device complexity through advance preparation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements dynamic rendering where the edge device adapts its rendering process based on device position changes within viewing angles. When the local device moves within the original viewing angle, the edge device performs local rendering updates; when movement exceeds the viewing angle, it requests new content from remote servers. This dynamic approach optimizes latency reduction while managing device complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240087238A1System and method for extended reality processing in a local wireless environment with reduced latency
Publication Date: 2024.03.14 T MOBILE INNOVATIONS LLC
  • US20240087238A1 patent drawing
  • US20240087238A1 patent drawing
  • US20240087238A1 patent drawing

AI summary

Aspects herein provide a system, media, and methods for a mobile edge computer that renders extended reality (XR) in support of a local user device, via a local network. The mobile edge computer can continue to provide updated XR renderings in near real-time when user position data remains within a particular viewing angle, without requesting updated content or rendering assistance from a remote application. When user position data is determined to be outside of the viewing angle, then the mobile edge computer may request additional content from the remote application.