Cloud Vehicle XR Rendering for Real-Time Object Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current wireless communication systems, particularly in the context of 5G NR, face challenges in providing efficient and immersive extended reality (XR) experiences for vehicle-based applications, especially in handling complex scenarios that require real-time identification and processing of vehicle-surrounding information.
Innovation Solution
The implementation of a cloud-based XR system that offloads processing associated with presenting augmentation information from the vehicle UE to a cloud XR entity. This system enables real-time identification of real-world objects and generation of rendering information, enhancing the XR experience by providing accurate and interactive content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If vehicle UE performs real-time processing of vehicle-surrounding information for XR rendering, then XR rendering accuracy is improved, but computational load and energy consumption increase
Solution Approach 1:
The patent extracts the complex computational tasks for processing vehicle-surrounding information and XR rendering from the vehicle UE to a cloud-based XR system. The vehicle UE only needs to capture and transmit raw sensor data, while the cloud system performs the intensive processing, rendering, and returns the processed XR content to the vehicle UE for display.
2Reliability
If vehicle UE processes complex XR scenarios in real-time, then XR experience quality is improved, but system complexity increases
Solution Approach 1:
The patent introduces a cloud-based XR system as an intermediary between the vehicle UE and the complex processing requirements. The cloud system acts as a mediator that receives raw data from the vehicle, performs sophisticated processing including object identification and XR rendering, and returns processed content to the vehicle UE, thereby reducing the complexity burden on the vehicle system.
3Loss of time
If local processing is performed at vehicle UE, then response time is reduced, but processing capability is limited
Solution Approach 1:
The patent transitions the processing capability from a single dimension (local vehicle UE processing) to multiple dimensions by leveraging cloud computing resources. The system distributes processing tasks between the vehicle UE (data capture and transmission) and the cloud system (intensive processing and rendering), effectively expanding the available processing power beyond what the vehicle UE could provide alone.
Data Source
AI summary
Apparatus, methods, and computer-readable media for facilitating a cloud-based vehicle XR user experience are disclosed herein. An example method for wireless communication at a user equipment (UE) includes transmitting a request for a vehicle extended reality (XR) session. The vehicle XR session may be based on a first user XR stream including a vehicle XR component associated with a vehicle and a first user XR component associated with a first user. The first user may have an association with the vehicle. The example method also includes transmitting uplink information associated with the first user XR stream. The example method also includes receiving rendering information associated with the first user XR stream. The rendering information may be based on the uplink information.