Mixed Reality Virtual Content Compositing Single Pass
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality systems face computational expense and latency issues due to the multi-pass process of warping and compositing virtual content from multiple sources, which is not compatible with real-time and portable systems.
Innovation Solution
The method involves warping and compositing virtual content from multiple sources in a single pass, using a compositor that generates warped content based on a unified pose, and performs depth testing to resolve conflicts, reducing processor burden and time requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a multi-pass process is used for warping and compositing virtual content from multiple sources, then the virtual content can be accurately rendered in different frame references, but the computational expense and processing time increase significantly
Solution Approach 1:
The patent merges multiple warping and compositing operations into a single pass process. Instead of performing warping for each virtual object separately in multiple passes, the system warps all virtual objects from different sources simultaneously in one pass, then composites them together. This reduces the number of processing iterations while maintaining rendering accuracy.
Solution Approach 2:
The patent performs preliminary warping transformations for all virtual objects before the final compositing operation. By pre-computing the warped versions of virtual objects from multiple sources in advance, the system eliminates the need for repeated warping operations during the compositing process, thereby reducing overall computational expense.
2Adaptability or versatility
If a multi-pass warping and compositing process is implemented, then virtual content from multiple applications can be integrated, but system latency increases making it unsuitable for real-time applications
Solution Approach 1:
The system combines multiple warping operations and compositing operations into a single unified pass. All virtual objects from different applications are warped and composited simultaneously in one processing iteration, eliminating the sequential delays inherent in multi-pass approaches and achieving real-time performance.
Solution Approach 2:
The patent maintains continuous processing by performing all necessary warping and compositing operations in a single uninterrupted pass. This continuous action eliminates the idle time and sequential delays between multiple passes, ensuring that virtual content from multiple sources is integrated without introducing significant latency.
3Ease of manufacture
If multiple virtual objects are warped and composited in separate passes, then each object can be processed independently, but the processor burden and time requirements increase
Solution Approach 1:
The patent merges independent warping operations for multiple virtual objects into a single parallel processing pass. Instead of processing objects sequentially in separate passes, the system performs all warping operations simultaneously in one pass, then combines the results. This reduces the total processor burden while maintaining the simplicity of the processing approach.
Data Source
AI summary
A computer implemented method for warping virtual content from two sources includes a first source generating first virtual content based on a first pose. The method also includes a second source generating second virtual content based on a second pose. The method further includes a compositor processing the first and second virtual content in a single pass. Processing the first and second virtual content includes generating warped first virtual content by warping the first virtual content based on a third pose, generating warped second virtual content by warping the second virtual content based on the third pose, and generating output content by compositing the warped first and second virtual content.