3D Application Multitasking Shell With Cooperative and Exclusive Modes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial reality systems, such as XR systems, lack concurrent execution and display of multiple applications, requiring manual user workflows for application switching.
Innovation Solution
Implement a system shell that allows concurrent execution and display of multiple applications in a three-dimensional environment, with mechanisms for seamless state storage and restoration of virtual objects, and mode management to facilitate efficient application switching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If XR systems omit concurrent execution and display of multiple applications, then the system complexity is reduced, but the productivity and user efficiency deteriorate
Solution Approach 1:
The system segments the display environment into multiple independent virtual object display regions, each capable of displaying different applications simultaneously. This allows concurrent execution without overwhelming complexity by organizing the display into manageable spatial segments.
Solution Approach 2:
The patent transitions from traditional sequential application execution to concurrent execution by utilizing three-dimensional spatial arrangement. Multiple applications are displayed as virtual objects in different spatial positions and depths, enabling simultaneous visibility and interaction without increasing operational complexity.
2Device complexity
If manual user workflow is used for application switching, then the device complexity is reduced, but the loss of time increases
Solution Approach 1:
The system performs preliminary actions by maintaining multiple applications in concurrent execution states and pre-positioning them in the virtual environment. When a user switches applications, the target application is already ready and visible, eliminating the need for sequential loading and reducing switching time.
Solution Approach 2:
The system implements feedback mechanisms that track user interactions and application states in real-time. This enables automatic updates to the display configuration and application states based on user actions, reducing the manual steps required for application switching and improving overall efficiency.
3Productivity
If concurrent execution of multiple applications is implemented, then the productivity is improved, but the device complexity increases
Solution Approach 1:
The system employs a universal virtual object display framework that can accommodate multiple different applications within the same concurrent execution environment. This multi-functional platform handles diverse application types through a unified spatial display mechanism, improving productivity without proportionally increasing complexity.
Solution Approach 2:
The patent implements a nested structure where multiple applications are organized within hierarchical layers of the virtual environment. Applications can be nested at different depths and spatial levels, allowing concurrent execution while maintaining an organized, manageable structure that prevents exponential complexity growth.
4Reliability
If state storage and restoration mechanisms are implemented, then the reliability is improved, but the device complexity increases
Solution Approach 1:
The system creates copies of application states and virtual object configurations at different points in time. These state copies are stored and can be restored when needed, ensuring reliability without requiring complex real-time synchronization mechanisms. The copying approach simplifies state management by creating discrete, manageable snapshots.
Data Source
AI summary
Aspects of the present disclosure are directed to application multitasking in a shell with a three-dimensional environment. Implementations immerse a user in a three-dimensional environment via an artificial reality system, such as a display environment for a system shell. The system shell can execute applications (e.g., system shell applications, remoted applications, etc.). An executing application can correspond to a displayed virtual object (e.g., panel). The system shell can concurrently execute two, three, or more applications and the three-dimensional environment can concurrently display two, three, or more corresponding virtual objects that display contents for the executing applications. Implementations of a mode manager can manage a mode for the three-dimensional environment/system shell. Example modes include cooperative mode and exclusive mode. Implementations of cooperative mode permit concurrent display of multiple virtual objects from different applications while the exclusive mode permits display of virtual objects only from the executing application entering exclusive mode.


