VR/AR Web Content Delivery with Initial View Object Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for delivering and performing WebVR and WebAR pages face inefficiencies in rendering and loading, particularly in prioritizing and optimizing the delivery of objects within the user's field of view, leading to slower load times and degraded user experience.
Innovation Solution
An asynchronous analysis system that captures characteristics of objects in the VR/AR scene, generates an object loading list (OLL) prioritizing objects based on their visibility and importance, and uses HTTP/2 push and Early Hints to optimize content delivery, ensuring critical objects are loaded first.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If all objects in the VR/AR scene are loaded simultaneously using traditional web delivery methods, then complete scene content is available, but loading time increases and initial field of view rendering is delayed
Solution Approach 1:
The system performs preliminary analysis of the VR/AR scene to identify objects in the initial field of view before actual delivery. This allows the server to pre-prioritize and push critical objects (those visible immediately) before less important objects, ensuring fast rendering of the initial view without waiting for all objects to load
Solution Approach 2:
The patent segments the VR/AR scene objects into different priority levels based on their visibility and importance. Objects are divided into categories such as 'initial field of view objects' (highest priority), 'subsequent field of view objects' (medium priority), and 'background objects' (lower priority). This segmentation enables differential delivery strategies for different object groups
2Productivity
If traditional HTTP delivery methods are used without prioritization, then all objects are delivered, but the delivery order is not optimized for VR/AR rendering performance
Solution Approach 1:
The system uses feedback from scene analysis to dynamically adjust the delivery order. The analysis server examines the VR/AR scene structure, camera positions, and object visibility to generate prioritization information that feeds back into the content delivery process, enabling adaptive optimization of object delivery sequences
Solution Approach 2:
The patent introduces an analysis server as an intermediary component between the origin server and the client browser. This intermediary analyzes the VR/AR scene, determines object priorities, and communicates the optimized delivery order to the content delivery system, adding intelligence without significantly increasing overall system complexity
3Illumination intensity
If VR/AR web pages use detailed 3D objects and high-quality assets, then visual quality improves, but loading time and bandwidth consumption increase
Solution Approach 1:
The system applies partial action by delivering only the necessary subset of objects first - specifically those in the initial field of view - at high quality. Less critical objects can be delivered later or in reduced quality, allowing the system to achieve acceptable visual quality for the immediate view while reducing initial bandwidth consumption
Data Source
AI summary
Among other things, this document describes systems, devices, and methods for improving the delivery and performance of web pages authored to produce virtual reality (VR) or augmented reality (AR) experiences. In some embodiments, such web pages are analyzed. This analysis may be initiated at the request of a content server that receives a client request for the HTML. The analysis may involve, asynchronous to the client request, loading the page into a non-user-facing browser environment and allowing the VR or AR scene to execute, even including executing animation routines for a predetermined period of time. Certain characteristics of the scene and of objects are thereby captured. Based on this information, an object list ordered by loading priority is prepared. Consulting this information in response to subsequent requests for the page, a content server can implement server push, early hints and/or other delivery enhancements.