AR Reprojection Plane Positioning for Low-Latency Digital Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices, particularly AR glasses, face inefficiencies and resource wastage due to frame rate discrepancies between rendering and compositor components, leading to presentation errors like judder and double imaging, which degrade user experience and increase power consumption.
Innovation Solution
A system that provides positioning information to the compositor component to dynamically adjust the reprojection plane based on digital effect positioning, allowing the compositor to operate without waiting for updated 3D scene reconstructions, thus reducing power consumption and improving visual stability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the compositor component waits for updated 3D scene reconstructions to configure the reprojection plane, then positioning accuracy is improved, but latency and power consumption increase
Solution Approach 1:
The digital effect application pre-calculates and provides positioning information for digital effects in advance. The compositor component uses this pre-provided positioning information to configure the reprojection plane without waiting for updated 3D scene reconstructions, thereby reducing latency while maintaining positioning accuracy.
2Reliability
If the rendering component operates at high frame rate, then visual quality is improved, but power consumption increases
Solution Approach 1:
The system dynamically adjusts the frame rate of the rendering component based on operational conditions. By changing the frame rate parameter, the system optimizes the balance between visual quality and power consumption, allowing the rendering component to operate at lower frame rates when high visual quality is not critical, thereby reducing power consumption.
3Stability of the object's composition
If the compositor component operates at higher frame rate than rendering, then visual stability is improved, but resource wastage increases
Solution Approach 1:
The digital effect positioning information acts as an intermediary that enables the compositor component to operate at higher frame rates without requiring corresponding increases in rendering frame rate. This intermediary positioning information allows the compositor to maintain visual stability while avoiding the resource wastage that would occur if it had to wait for or process additional rendered frames.
Data Source
AI summary
A system for presenting digital effects in a head-wearable apparatus is provided. The system generates, by a digital effect application, one or more digital effects for presentation on a digital effect display component and receives, by the digital effect display component, the one or more digital effects, the digital effect display component. The system receives, by the digital effect display component from the digital effect application, positioning information for the one or more digital effects in three-dimensional (3D) space. The system configures, by the digital effect display component, a two-dimensional (2D) re-projection plane based on the positioning information received from the digital effect application and displays, by the digital effect display component, the one or more digital effects on the 2D re-projection plane.