VR/AR Web Page Delivery Using Object Loading Priority

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies for delivering and performing WebVR and WebAR pages face inefficiencies in loading and rendering, particularly in prioritizing objects within the user's field of view, leading to slower load times and degraded user experience.

Innovation Solution

An asynchronous analysis system that captures characteristics of objects in a VR/AR scene, generates an object loading list (OLL) prioritizing objects based on their visibility and importance, and uses HTTP/2 push and Early Hints to optimize content delivery, ensuring critical objects are loaded first.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If all objects in a VR/AR web page are loaded in traditional order, then complete scene content is available, but loading time increases and user experience degrades

Engineering Contradiction:
Improveloading speedVSAvoidload time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the VR/AR scene to identify and prioritize objects that will be in the user's field of view during initial rendering. This allows the server to pre-determine the optimal loading sequence before the user actually views the content, ensuring critical objects are loaded first without requiring the user to wait for the entire scene to load.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The VR/AR scene is segmented into multiple priority levels based on object importance and expected visibility. Instead of loading all objects uniformly, the system divides them into priority groups (e.g., high-priority objects in initial field of view, medium-priority objects, low-priority background objects) and loads them in sequence, allowing the critical portion of the scene to become available faster.

Inventive Principle:
Principle #1Segmentation

2Productivity

If traditional content delivery methods are used for VR/AR pages, then implementation is simple, but rendering performance and user experience are degraded

Engineering Contradiction:
Improverendering performanceVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

An intermediary analysis system is introduced between the content server and the user's browser. This intermediary performs scene analysis, generates priority information, and communicates loading priorities to the browser. While this adds a component to the system, it automates the complexity management and enables significantly improved rendering performance without requiring complex client-side implementation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11811853B2Systems and methods for content delivery acceleration of virtual reality and augmented reality web pages
Publication Date: 2023.11.07 AKAMAI TECHNOLOGIES INC
  • US11811853B2 patent drawing
  • US11811853B2 patent drawing
  • US11811853B2 patent drawing

AI summary

Among other things, this document describes systems, devices, and methods for improving the delivery and performance of web pages authored to produce virtual reality (VR) or augmented reality (AR) experiences. In some embodiments, such web pages are analyzed. This analysis may be initiated at the request of a content server that receives a client request for the HTML. The analysis may involve, asynchronous to the client request, loading the page into a non-user-facing browser environment and allowing the VR or AR scene to execute, even including executing animation routines for a predetermined period of time. Certain characteristics of the scene and of objects are thereby captured. Based on this information, an object list ordered by loading priority is prepared. Consulting this information in response to subsequent requests for the page, a content server can implement server push, early hints and/or other delivery enhancements.