Intelligent Smoothing of 3D AR Applications for Secondary 2D Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote viewing of 3D alternative reality applications on a 2D screen results in a jittery experience for viewers due to the direct translation of the user's head movements, leading to unpleasant side effects like nausea and dizziness.
Innovation Solution
A system and method for intelligent smoothing of 3D alternative reality applications, where a computing device receives position data from an alternative reality viewing device, determines differences in position data above a threshold, and updates the 2D rendering accordingly, using interpolation routines to animate movement smoothly, thereby reducing jitter.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the alternative reality user's head movements are directly translated to the 2D rendering, then the viewing experience for users inside the headset is accurate and responsive, but the viewing experience for external viewers becomes jittery and causes unpleasant side effects
Solution Approach 1:
A computing device acts as an intermediary between the alternative reality headset and the external display device. It receives position data from the headset, applies smoothing algorithms to reduce jitter, and generates smoothed 2D renderings for external viewers. This mediator resolves the contradiction by processing the raw head movement data differently for internal versus external viewers.
Solution Approach 2:
The system changes the temporal parameters of the rendering updates by introducing smoothing algorithms that average or interpolate position data over time. This transforms the raw, jittery position signals into smoothed trajectories, reducing high-frequency movements that cause visual discomfort for external viewers while preserving the responsiveness needed for headset users.
2Measurement precision
If position data is updated continuously to reflect real-time head movements, then the virtual environment remains synchronized with user movements, but the 2D rendering becomes excessively jittery
Solution Approach 1:
The system dynamically adjusts the update frequency and smoothing intensity based on movement characteristics. During periods of rapid or erratic head movement, increased smoothing is applied to stabilize the 2D rendering. During periods of stable viewing, the smoothing is reduced to maintain responsiveness and accuracy, thus adapting to varying operational conditions.
Solution Approach 2:
The system applies partial updates to the 2D rendering by selectively smoothing certain position components more than others. Instead of uniformly reducing all position updates, it applies differential smoothing that preserves essential movements while filtering out jitter, achieving a balance between accuracy and stability.
Data Source
AI summary
Methods and apparatuses are described for intelligent smoothing of 3D alternative reality applications for secondary 2D viewing. A computing device receives a first data set corresponding to a first position of an alternative reality viewing device. The computing device generates a 3D virtual environment for display on the alternative reality viewing device using the first data set, and a 2D rendering of the virtual environment for display on a display device using the first data set. The computing device receives a second data set corresponding to a second position of the alternative reality viewing device after movement of the alternative reality viewing device. The computing device determines whether a difference between the first data set and the second data set is above a threshold. The computing device updates the 2D rendering of the virtual environment on the display device using the second data set, when the difference is above the threshold value.