VST AR Distortion Pre-Warping for Low-Latency Final Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video see-through augmented reality (AR) systems suffer from distortions in image frames due to see-through camera and display lenses, leading to latency issues during distortion correction.
Innovation Solution
A method to identify and combine distortions from both camera and display lenses, pre-warping images to offset combined distortions, and present the pre-warped images to users, using a distortion mesh to simplify and speed up the correction process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If distortion correction is applied separately for camera and display lenses, then each distortion can be addressed, but latency increases due to multiple processing steps
Solution Approach 1:
The patent combines separate distortion correction processes for camera lenses and display lenses into a single unified pre-warping operation. By merging these corrections into one computational step that processes both distortions simultaneously, the system achieves the same correction accuracy while reducing the number of processing passes and minimizing latency.
Solution Approach 2:
The patent applies pre-warping transformation in advance to the captured image frames, combining both camera and display lens distortion corrections into a single preliminary processing step. This preliminary action prepares the image beforehand so that no additional distortion correction is needed during the display pipeline, thereby reducing real-time processing latency.
2Manufacturing precision
If multiple separate distortion corrections are applied, then comprehensive distortion removal is achieved, but the processing pipeline becomes more complex
Solution Approach 1:
The patent merges multiple separate distortion correction operations into a single unified pre-warping transformation. By combining the camera lens distortion correction and display lens distortion correction into one integrated processing step, the system maintains comprehensive distortion removal while significantly simplifying the processing pipeline architecture.
3Manufacturing precision
If real-time distortion correction is implemented, then image quality is improved, but processing time increases
Solution Approach 1:
The patent performs distortion correction as a preliminary pre-warping operation on captured frames before they enter the main rendering pipeline. By completing both camera and display lens corrections in advance as a single operation, the system ensures high image quality while maintaining real-time frame processing throughput without adding latency to the critical rendering path.
Data Source
AI summary
A method includes obtaining an image captured by a see-through camera of a video see-through (VST) augmented reality (AR) device. The method also includes identifying a first distortion created by at least one see-through camera lens and identifying a second distortion created by at least one display lens of the VST AR device. The method further includes determining a combined distortion based on the first distortion and the second distortion. The method also includes pre-warping the image to offset the combined distortion such that the image is not distorted when the pre-warped image is viewed by a user through the at least one display lens of the VST AR device. In addition, the method includes presenting the pre-warped image to the user on at least one display of the VST AR device.