Over-Rendered XR Reprojection Mesh for Frame Boundary Suppression

Solution Overview

Problem

XR systems face challenges in managing power consumption and integrating large batteries due to the high processing demands of powerful processors, leading to issues like frame boundary artifacts and jitter in wearable devices.

Innovation Solution

Implementing over-rendering techniques with an edge-aware smooth spatial gain map to suppress frame boundary artifacts by generating a mesh of vertices, reprojecting and pre-distorting images based on location changes, and rasterizing the images to compensate for field of view shifts in XR systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If over-rendering is used to provide a larger field of view, then the field of view is improved, but frame boundary artifacts are generated

Engineering Contradiction:

Improvefield of viewVSAvoidframe boundary artifacts

Core Design Contradiction:

Area of moving objectVSObject-generated harmful factors

Solution Approach 1:

The patent applies preliminary action by pre-distorting the mesh vertices before reprojection to anticipate and compensate for the frame boundary artifacts that would otherwise occur. The system calculates distortion information in advance and applies it to the mesh, so that when the image is reprojected and displayed, the artifacts are suppressed. This is evident in the steps where distortion information is generated and applied before the final rendering.

Inventive Principle:

Principle #10Preliminary action

2Speed

If powerful processors are used to perform feature analysis and complex functions, then processing speed is improved, but power consumption increases

Engineering Contradiction:

Improveprocessing speedVSAvoidpower consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The patent applies segmentation by dividing the processing functions between the wearable XR device and a connected device. The wearable device performs essential functions like mesh generation and reprojection, while more computationally intensive tasks can be offloaded to the connected device. This segmentation allows the wearable device to maintain acceptable processing speed while reducing its power consumption and battery requirements.

Inventive Principle:

Principle #1Segmentation

3Quantity of substance

If large and heavy batteries are used to support power usage of powerful processors, then power capacity is improved, but device weight and integration difficulty increase

Engineering Contradiction:

Improvebattery capacityVSAvoiddevice weight

Core Design Contradiction:

Quantity of substanceVSWeight of moving object

Solution Approach 1:

The patent applies segmentation by dividing the processing functions between the wearable XR device and a connected device. The wearable device performs essential functions like mesh generation and reprojection, while more computationally intensive tasks can be offloaded to the connected device. This segmentation allows the wearable device to maintain acceptable processing speed while reducing its power consumption and battery requirements.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS12633046B2Optimized over-rendering and edge-aware smooth spatial gain map to suppress frame boundary artifacts

Publication Date: 2026.05.19 QUALCOMM INC

AI summary

Techniques and systems are provided for image processing. For instance, a process can include: receiving an initial image rendered at a first time interval, the initial image having a larger field of view as compared to a field of view of a display; generating a mesh of vertices for the initial image, at least one vertex of the mesh corresponding to a portion of the initial image with the larger field of view; reprojecting the mesh of vertices based on a view angle change since the first time interval to obtain a reprojected mesh; generating estimated distortion information for the at least one vertex of the reprojected mesh corresponding to a portion of the initial image with the larger field of view; pre-distorting the reprojected mesh based on the estimated distortion information; and rasterizing the initial image based on the pre-distorted reprojected mesh to generate a reprojected image.