Distributed Content Rendering Pose-Based Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in reducing bandwidth usage when transmitting content rendering instructions from a first device to a second device, particularly in augmented and virtual reality environments, where high resolution and dynamic adjustments are required based on the pose of virtual objects.
Innovation Solution
The first device generates content rendering instructions based on the pose of virtual objects, adjusting resolution and size accordingly, and sends graphic commands that include API instructions to the second device, which renders the content, thereby optimizing bandwidth usage by excluding non-visible elements and using perspective transforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high resolution content rendering instructions are transmitted from the first device to the second device, then the rendering quality is improved, but the bandwidth consumption increases
Solution Approach 1:
The system transmits only the necessary portions of content rendering instructions based on the pose of the virtual object. When the virtual object is viewed from certain angles or distances, only specific regions are visible, so the system transmits rendering data for those specific regions rather than the entire content, thereby reducing bandwidth consumption while maintaining rendering quality for visible areas.
Solution Approach 2:
The system transmits a partial set of content rendering instructions rather than complete high-resolution data for all possible views. By sending only the subset of rendering data needed for the current pose configuration, the system achieves adequate rendering quality for the visible portions while significantly reducing the quantity of transmitted data.
2Productivity
If content rendering instructions are dynamically adjusted based on virtual object pose, then the rendering efficiency is improved, but the system complexity increases
Solution Approach 1:
The system continuously monitors the pose of virtual objects and uses this feedback information to dynamically adjust which content rendering instructions are transmitted. The pose data serves as feedback that triggers selective transmission of rendering instructions, improving rendering efficiency by ensuring only relevant content is sent while the feedback mechanism manages the complexity of dynamic adjustments.
Solution Approach 2:
The system transitions from static transmission of all rendering instructions to dynamic selection based on virtual object pose. The rendering instruction set becomes dynamic, adapting to the current view configuration, which improves efficiency by transmitting only what is needed while the dynamic nature introduces manageable complexity through pose-based conditional logic.
Data Source
AI summary
In one implementation, a method of distributed content rendering is performed at a first device including a display, one or more processors, and non-transitory memory. The method includes determining a pose of a virtual object in a volumetric environment. The method includes generating a request for content rendering instructions based on the pose of the virtual object. The method includes sending, to a second device, the request for the content rendering instructions. The method includes receiving, from the second device, the content rendering instructions. The method includes displaying, based on the content rendering instructions, a content rendering on the virtual object.