3D Application Multitasking With Cooperative And Exclusive Modes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial reality systems, such as XR systems, lack the ability to concurrently execute and display multiple applications, and switching between applications involves a manual user workflow with multiple steps.
Innovation Solution
Implement a system shell that allows concurrent execution and display of multiple applications in a three-dimensional environment, with mechanisms for seamless transition and state management of virtual objects, including cooperative and exclusive modes, and a theater screen for shared content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If XR systems omit concurrent execution and display of multiple applications, then the system complexity is reduced, but the productivity and user interaction efficiency deteriorate
Solution Approach 1:
The system segments the display space into multiple virtual object containers that can independently display different applications simultaneously. Each virtual object acts as an independent execution context, allowing concurrent application display without requiring complete system redesign, thus resolving the contradiction between complexity and productivity.
Solution Approach 2:
The patent implements nesting by allowing virtual objects to contain other virtual objects or nested display contexts. This hierarchical structure enables multiple applications to be displayed concurrently at different levels of nesting, increasing productivity while managing complexity through organized layers rather than flat simultaneous execution.
2Reliability
If manual user workflow with several steps is used for switching between applications, then the system reliability is maintained, but the ease of operation deteriorates
Solution Approach 1:
The system implements self-service by automatically managing application switching and state persistence without requiring manual user intervention. When a user views content from one application, the system automatically preserves the state of that application and enables quick switching to other applications, maintaining reliability through automated state management while dramatically improving ease of operation.
Solution Approach 2:
The system performs preliminary actions by pre-loading application states and preparing virtual object displays before the user needs to switch applications. This anticipatory state preservation and pre-positioning of virtual objects eliminates the need for manual switching workflows, maintaining system reliability while making operation seamless and intuitive.
3Productivity
If multiple applications are displayed concurrently in a three-dimensional environment, then the productivity and user interaction efficiency are improved, but the device complexity increases
Solution Approach 1:
The system employs a universal virtual object framework that can display multiple different applications within the same three-dimensional environment. This multi-functional virtual object system allows a single framework to handle diverse application types concurrently, improving productivity while avoiding the complexity of separate display systems for each application.
Solution Approach 2:
The patent utilizes three-dimensional spatial arrangement to display multiple applications concurrently, moving from traditional two-dimensional sequential display to three-dimensional parallel display. This dimensional transition allows multiple applications to coexist in spatial layers and depths, improving user interaction efficiency while managing complexity through spatial organization rather than additional processing layers.
Data Source
AI summary
Aspects of the present disclosure are directed to application multitasking in a shell with a three-dimensional environment. Implementations immerse a user in a three-dimensional environment via an artificial reality system, such as a display environment for a system shell. The system shell can execute applications (e.g., system shell applications, remoted applications, etc.). An executing application can correspond to a displayed virtual object (e.g., panel). The system shell can concurrently execute two, three, or more applications and the three-dimensional environment can concurrently display two, three, or more corresponding virtual objects that display contents for the executing applications. Implementations of a mode manager can manage a mode for the three-dimensional environment/system shell. Example modes include cooperative mode and exclusive mode. Implementations of cooperative mode permit concurrent display of multiple virtual objects from different applications while the exclusive mode permits display of virtual objects only from the executing application entering exclusive mode.