Mixed Reality Virtual Object Display for Multitasking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limited screen size of terminals often prevents simultaneous display of multiple computer applications, requiring users to rely on icons and command operations to access them, leading to reduced visual feedback and inefficient multitasking in mixed reality environments.
Innovation Solution
A method that allows users to extend the display of computer applications beyond the terminal screen by using a mixed reality headset or glasses, which communicates with a second terminal to obtain positioning data and display virtual objects superimposed on the real environment, enabling multiple applications to be displayed simultaneously and interacted with.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple application windows are displayed on a terminal screen, then the user can access multiple applications simultaneously, but the limited screen size prevents all windows from being clearly visible
Solution Approach 1:
The patent extends the display from two-dimensional screen space to three-dimensional virtual space. Virtual objects representing application windows are positioned in 3D space around the user, allowing multiple windows to be displayed simultaneously without competing for limited 2D screen real estate. This dimensional transition resolves the contradiction by providing abundant display space while maintaining simultaneous access to multiple applications.
Solution Approach 2:
The patent introduces virtual objects as intermediaries between the user and actual application windows. These virtual representations allow users to interact with and manipulate application windows in 3D space, effectively mediating the display of multiple applications without requiring all windows to occupy physical screen space. The virtual objects serve as proxies that resolve the space limitation.
2Adaptability or versatility
If application windows are reduced to simple icons to fit more applications, then more applications can be accessed, but visual feedback is reduced and command operations are required
Solution Approach 1:
The patent creates virtual copies of application windows that preserve the full visual content and functionality of the original windows. Instead of reducing windows to icons, the system generates accurate visual replicas in 3D space that maintain all visual feedback elements. Users can see and interact with complete window content, not just symbolic representations, thereby eliminating information loss while enabling multi-application access.
3Area of stationary object
If the terminal screen size is increased to display more windows, then more applications can be displayed simultaneously, but the portability and compactness of the terminal is reduced
Solution Approach 1:
The patent resolves the display area versus device size contradiction by transitioning from 2D screen display to 3D virtual space. The terminal maintains its compact physical form while providing expansive display capabilities through spatial positioning of virtual objects in three dimensions. This allows large effective display area without increasing physical terminal dimensions.
Data Source
Figure 1~4
Figure 2A~2B
Figure 5~6
AI summary
The invention relates to a mixed reality display method for at least one virtual object, the method comprising the following steps implemented by a first terminal: • sending (E410) at least one positioning data of a pointer positioned on a part of a first window of a computer application, the first window being displayed by a second terminal, • receiving (E420) at least one data relating to the part of the first window, • processing (E430) of the at least one data relating to the part of the first window, so as to display in mixed reality the at least one virtual object, from the at least one data relating to the part of the first window.