3D Multi-Window Processing for Concurrent XR Application Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Extended reality devices currently only allow interaction with a single three-dimensional application at a time, limiting user interaction modes and resulting in a poor experience when multiple applications are needed simultaneously.
Innovation Solution
A multi-window processing method and system that enables simultaneous display and interaction with both two-dimensional and three-dimensional windows in a three-dimensional space by generating a transformation matrix based on attribute information and processing windows accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single three-dimensional application occupies the entire space for immersive experience, then the immersion quality is improved, but the user cannot interact with multiple applications simultaneously
Solution Approach 1:
The patent segments the single three-dimensional space into multiple independent window regions, each capable of displaying a different application. This allows the space to be divided into multiple functional areas while maintaining the overall three-dimensional immersive environment, enabling users to interact with multiple applications simultaneously without compromising immersion quality.
Solution Approach 2:
The patent transitions from traditional two-dimensional windowing systems to a three-dimensional windowing system where windows have spatial depth and can be positioned, rotated, and scaled in three-dimensional space. This dimensional enhancement allows multiple windows to coexist in the same physical space without overlapping, providing both immersion and multi-application interaction capabilities.
2Adaptability or versatility
If traditional two-dimensional multi-window systems are used on extended reality devices, then multi-application interaction is enabled, but the three-dimensional immersive experience is lost
Solution Approach 1:
The patent elevates the traditional two-dimensional windowing concept into three-dimensional space, where windows are no longer flat surfaces but spatial objects with depth, position, and orientation attributes. This allows multiple applications to be displayed in three-dimensional arrangements that preserve the immersive experience while enabling multi-application interaction.
Solution Approach 2:
The patent creates a universal windowing system that can accommodate both two-dimensional and three-dimensional applications within the same three-dimensional space. The system automatically adapts the display characteristics of each window based on its content requirements, allowing 2D applications to be displayed in 3D space without losing their original display qualities while maintaining the overall immersive environment.
3Adaptability or versatility
If multiple three-dimensional content applications are run simultaneously in 360-degree space, then multi-tasking capability is improved, but current technology only allows one application at a time while others are suspended or hidden
Solution Approach 1:
The patent divides the 360-degree space into multiple discrete window regions, each dedicated to a specific application. This segmentation allows the system to manage multiple applications independently while maintaining organized spatial separation, reducing the complexity of application management by providing clear boundaries and designated areas for each application.
Solution Approach 2:
The patent implements dynamic window management where windows can be freely positioned, resized, rotated, and adjusted in real-time based on user interaction and application requirements. This dynamic capability allows the system to adapt to different multi-tasking scenarios automatically, simplifying application management by providing flexible spatial organization rather than fixed layouts.
Data Source
Figure 1A~1B
Figure 2
Figure 3~4A
AI summary
The present invention relates to the field of computer systems. Provided are a multi-window processing method and system in a three-dimensional space, and a device. The method comprises: receiving attribute information of one or more windows, wherein the windows comprise a two-dimensional window and/or a three-dimensional window; generating a corresponding transformation matrix according to the attribute information of the one or more windows; and processing the one or more windows on the basis of the transformation matrix, wherein processing the one or more windows on the basis of the transformation matrix comprises: displaying the one or more windows on the basis of the transformation matrix, and transforming an event from a three-dimensional space to a target window on the basis of the transformation matrix and sending same to the target window. By means of the present invention, one or more two-dimensional windows and one and more three-dimensional windows can be simultaneously displayed in a three-dimensional environment, such that a user simultaneously performs interaction on the windows, thereby increasing the application scenarios of an extended-reality device, and improving the user experience.