Multi-Sampling Pose Reprojection for Lower-Latency XR Displays

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

XR systems face challenges with high power consumption and latency due to split rendering between companion devices and head-mounted displays, leading to inconsistent immersive experiences.

Innovation Solution

Implement multi-sampling poses during reprojection to reduce perceived latency by pre-calculating reprojection settings based on initial head poses and applying heuristic updates using subsequent poses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Weight of moving object

If split rendering is implemented between companion device and HMD display, then device weight and size are reduced, but latency increases

Engineering Contradiction:

ImproveHMD display weightVSAvoidlatency

Core Design Contradiction:

Weight of moving objectVSLoss of time

Solution Approach 1:

The system performs preliminary reprojection calculations based on initial head poses before the actual display occurs. By pre-calculating reprojection parameters and preparing frames in advance, the system reduces the processing time required during display, thereby reducing perceived latency without requiring the HMD to perform all rendering tasks locally.

Inventive Principle:

Principle #10Preliminary action

2Speed

If powerful processors are used for feature analysis and complex functions, then processing speed is improved, but power consumption increases

Engineering Contradiction:

Improveprocessing speedVSAvoidpower consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The rendering workload is segmented and distributed between the companion device (which performs computationally intensive feature analysis and initial rendering using powerful processors) and the HMD display (which performs lighter reprojection tasks). This segmentation allows the HMD to maintain low power consumption while still achieving acceptable processing speeds for its simplified tasks.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Instead of the HMD performing all rendering calculations from scratch, the system copies pre-rendered frames from the companion device and applies reprojection transformations to create the final display output. This copying approach significantly reduces the computational burden and power consumption of the HMD while maintaining visual quality.

Inventive Principle:

Principle #26Copying

3Loss of time

If multi-sampling poses during reprojection is implemented, then latency is reduced, but device complexity increases

Engineering Contradiction:

Improveeffective latencyVSAvoidprocessing complexity

Core Design Contradiction:

Loss of timeVSDevice complexity

Solution Approach 1:

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20250252593A1Multi-sampling poses during reprojection

Publication Date: 2025.08.07 QUALCOMM INC

AI summary

Techniques and systems are provided for displaying images. For instance, a process can include determining a portion of reprojection information for the frame based on a second head pose, wherein the second head pose is obtained after the first head pose is obtained; updating the portion of the reprojection information based on a third head pose to generate updated reprojection information, wherein the third head pose is obtained after the second head pose is obtained; applying the updated reprojection information to the frame to generate a reprojected frame; and outputting the reprojected frame for display.