XR Experience Hierarchy for Resource-Aware Augment Rendering

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing XR systems lack an efficient hierarchy for managing multiple experiences and their augments, leading to excessive resource consumption and inefficient utilization on XR devices.

Innovation Solution

Implementing a hierarchical framework that manages XR experiences and augments with various states, optimizing resource allocation and capabilities based on their importance, and selectively moderating or minimizing less priority augments to conserve battery power, heat, bandwidth, and processing power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple XR experiences and augments are managed without a hierarchy, then all experiences can run simultaneously with full capabilities, but resource consumption becomes excessive and device performance degrades

Engineering Contradiction:

Improveexperience durationVSAvoidbattery power consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent segments XR experiences and augments into a hierarchical structure with foreground and background states. Foreground experiences receive full resource allocation while background experiences receive reduced allocation. This segmentation allows the system to manage multiple experiences simultaneously without excessive resource consumption, extending device usage duration while controlling battery power consumption.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic state transitions between foreground and background for different experiences and augments. The system can dynamically adjust resource allocation based on user interaction, allowing experiences to move between states. This dynamic management optimizes resource usage patterns, reducing battery consumption during low-activity periods while maintaining productivity when needed.

Inventive Principle:

Principle #15Dynamics

2Reliability

If all augments are rendered with full processing power, then visual quality and interactivity are maximized, but heat generation and power consumption increase significantly

Engineering Contradiction:

Improverendering qualityVSAvoiddevice heat

Core Design Contradiction:

ReliabilityVSTemperature

Solution Approach 1:

The patent applies local quality by rendering different levels of detail for different augments based on their state. Foreground augments receive full rendering quality while background augments receive reduced quality. This allows the system to maintain acceptable visual quality for active elements while reducing overall heat generation and power consumption.

Inventive Principle:

Principle #3Local quality

3Productivity

If a hierarchical management system is implemented, then resource consumption is optimized and experience duration is extended, but system complexity increases

Engineering Contradiction:

Improveresource efficiencyVSAvoidmanagement system complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a universal hierarchical framework that manages multiple experiences and augments through common state transitions and resource allocation rules. This multi-functional approach consolidates management logic into a unified system that handles diverse XR content types, improving resource efficiency without proportionally increasing complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Power

If background experiences are minimized or unloaded, then battery power is conserved and processing speed improves, but user access to those experiences is delayed

Engineering Contradiction:

Improveprocessing speedVSAvoidexperience activation time

Core Design Contradiction:

PowerVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-loading background experiences and augments in a minimized state rather than completely unloading them. This allows experiences to be quickly activated when needed, reducing the time loss while still conserving battery power and improving processing speed during normal operation.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12548245B2Rendering an artificial reality environment based on a defined hierarchy of multiple states including multiple artificial reality experiences with augments

Publication Date: 2026.02.10 META PLATFORMS TECHNOLOGIES LLC

AI summary

Aspects of the present disclosure are directed to providing an augmented world environment model for an artificial reality (XR) environment. Some implementations of the present technology define how experiences will run on an XR system as a hierarchy of entities, including experiences, augments those experiences create, and an exclusive mode in which a particular experience takes control of the entire view. Some implementations can establish a framework for multiple experiences to interface with each other and to run in an XR ecosystem. This can improve upon traditional mobile and desktop operating systems by providing different states optimized for XR, which can include improved utilization of resources on an XR device, such as an XR head-mounted display. Experiences and augments can enter a particular state based on criteria, and can be, based on the state, processed differently by an operating system or provided with particular capabilities.