Mixed Reality System API Segmentation for VR Content Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality (MR) systems supporting virtual reality (VR) applications face low consumer interest due to limited available MR content, and existing technologies are incompatible with graphics applications, leading to inefficiencies in displaying MR environments.
Innovation Solution
A MR system with a processing device and MR headset that provides separate APIs for VR and MR contents, allowing the processing device to render and display texture data directly on the MR headset using a share handle, eliminating the need for additional encoding and decoding processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate APIs are provided for VR and MR contents, then compatibility and efficiency are improved, but device complexity increases
Solution Approach 1:
The system divides the API interface into two separate APIs: one for VR content rendering and another for MR content rendering. This segmentation allows each API to be optimized for its specific content type, improving compatibility without requiring a complete redesign of the entire rendering system.
Solution Approach 2:
The rendering device is designed to handle both VR and MR content types through a unified hardware architecture that supports multiple rendering modes. This multi-functionality allows the same device to serve diverse purposes while maintaining efficiency through specialized API pathways.
2Productivity
If texture data is rendered and displayed directly using share handle, then productivity and image quality are improved, but system resource consumption increases
Solution Approach 1:
The system performs preliminary rendering of texture data to a shared memory buffer before final display. By pre-processing the texture data and storing it in a share handle, the system avoids redundant encoding and decoding operations during display, thereby improving rendering efficiency while managing resource consumption through optimized memory usage.
3Ease of manufacture
If VR platform is combined with low-cost hardware, then ease of manufacture is improved, but manufacturing precision and reliability may deteriorate
Solution Approach 1:
The system adjusts rendering parameters and optimization strategies based on the capabilities of low-cost hardware. By dynamically modifying rendering quality settings, texture resolution, and processing intensity, the system maintains acceptable reliability and performance levels while utilizing more affordable hardware components.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A mixed reality (MR) system (100) supporting virtual reality (VR) applications and a display method thereof are provided, where the mixed reality system (100) includes a processing device (120) and a MR headset (110), and the processing device (120) provides a first application programming interface (API) (351) that runs VR contents and a second API (361) that runs MR contents. The method includes to obtain a first MR content, to inform the first API (351) about a display-related setting of the MR headset (110) through the second API (361), to render first texture data (TD) corresponding to the first VR content according to the display-related setting through the first API (351), to create and send a share handle (SH) to the second API (361), and to display the first texture data (TD) on the MR headset (110) through the second API (361) by using the share handle (SH).