Distributed DNN Ensemble Prediction for XR User Inputs at the Edge
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently predicting user inputs for extended reality (XR) devices using distributed neural networks, particularly in wireless environments, due to the complexity and variability of user interactions and environmental factors.
Innovation Solution
Implementing a system that utilizes multiple distributed deep neural networks (DNNs) and a model-predictive-control (MPC) controller running on an edge cloud as microservices to enhance data-driven prediction and user input prediction for XR devices, leveraging edge computing capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple distributed deep neural networks are implemented on edge cloud, then prediction accuracy improves, but system complexity increases
Solution Approach 1:
The patent divides the prediction system into multiple distributed deep neural networks operating independently on the edge cloud, each handling specific aspects of user input prediction. This segmentation allows the system to achieve higher accuracy through ensemble predictions while managing complexity by distributing computational loads across separate network instances.
Solution Approach 2:
The patent introduces an intermediary layer that coordinates between multiple distributed DNNs and the XR device, managing data flow, prediction aggregation, and model updates. This intermediary structure simplifies the overall system architecture by providing a standardized interface while enabling complex distributed processing.
2Reliability
If distributed neural networks adapt to real-time environmental factors, then prediction reliability improves, but computational energy consumption increases
Solution Approach 1:
The patent implements preliminary action by pre-training distributed neural networks offline with extensive environmental and user interaction data before deployment. This pre-training enables the models to adapt quickly to real-time conditions with minimal additional computational energy, as the heavy lifting of learning fundamental patterns has already been completed.
Solution Approach 2:
The system employs periodic action by updating and retraining the distributed DNNs at scheduled intervals rather than continuously. This approach maintains prediction reliability by periodically adapting to new environmental conditions and user behaviors while significantly reducing computational energy consumption compared to continuous real-time retraining.
3Speed
If edge computing capabilities are leveraged for prediction, then response speed improves, but infrastructure complexity increases
Solution Approach 1:
The patent extracts the computational workload for user input prediction from the centralized cloud infrastructure and relocates it to edge computing nodes closer to the XR devices. This extraction enables faster local processing and prediction generation, improving response speed while reducing the computational burden on the core infrastructure.
Data Source
AI summary
Procedures, methods, architectures, apparatuses, systems, devices, and computer program products are described for artificial intelligence/machine learning (AIML) models training. For example, a wireless transmit/receive unit (WTRU) is configured to send, to a network entity, first information comprising first data, wherein the network entity comprises a plurality of AI/ML models; receive, from the network entity, second data, wherein the second data are predicted data obtained from an aggregation of output data generated from the plurality of AIML models; determine a prediction error; send, to the network entity, a list of error correction algorithms associated with the plurality of AIML models; receive, from the network entity, second information indicating a rank-ordered list of the error correction algorithms; select an error correction algorithm based on the rank-ordered list of the error correction algorithms; and send, to the network entity, third information indicating the selected error correction algorithm.


