XR Application Lifecycle With Context Ranking and Permissions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial reality systems require users to manually discover and execute applications, leading to inefficiencies in locating relevant applications for a given context, and lack effective permission management and coordination among multiple applications, resulting in cluttered and difficult-to-navigate environments.
Innovation Solution
A method for suggesting, authorizing, and controlling application output in an artificial reality device by identifying anchor points, determining XR context, and using machine learning to match applications, setting permissions, and progressively downloading components, along with context-based ranking to manage application output.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If users manually discover and execute applications in existing artificial reality systems, then users can control application execution, but users experience inefficiency in locating relevant applications and increased time consumption
Solution Approach 1:
The system performs preliminary actions by proactively identifying and suggesting applications that match the current XR context before users need them. The system continuously monitors context parameters (location, objects, user state) and pre-selects relevant applications, so when users need functionality, the applications are already identified and ready for selection, eliminating manual searching time
Solution Approach 2:
The system serves itself by automatically managing application suggestions based on context analysis. The artificial reality system autonomously determines which applications are relevant to current situations without requiring users to actively search or request them, making the system self-aware of user needs and self-serve by presenting appropriate applications
2Adaptability or versatility
If multiple applications execute simultaneously in existing artificial reality systems, then users can access diverse functionality, but the environment becomes cluttered and difficult to navigate
Solution Approach 1:
The system applies local quality by managing application outputs and visual elements according to their specific locations and contexts within the XR environment. Different applications' outputs are differentiated and organized based on their relevance to specific anchor points, spatial positions, and contextual importance, making the environment navigable despite multiple concurrent applications
Solution Approach 2:
The system introduces an intermediary layer (the suggestion and management system) that mediates between multiple executing applications and the user experience. This intermediary organizes, prioritizes, and presents application outputs in a coordinated manner, preventing clutter by filtering and structuring the information flow from multiple sources
3Ease of manufacture
If existing artificial reality systems lack effective permission management, then applications can access resources freely, but security and control are compromised
Solution Approach 1:
Permission management is performed as a preliminary action during application selection and suggestion. Before applications execute or access resources, the system pre-establishes permission boundaries and access controls based on context and application requirements, ensuring security is built-in from the start rather than added later
Solution Approach 2:
The system implements feedback mechanisms for permission management by continuously monitoring application behavior and context changes. Permission grants are dynamically adjusted based on feedback from system state, application performance, and user interactions, maintaining reliability while allowing flexible deployment
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Aspects of the present disclosure are directed to an artificial reality (XR) application system controlling applications in an artificial reality environment. In various cases, these controls include automatically suggesting XR applications by determining an XR context and identifying applications that match the XR context. These applications can be suggested to a user, who can authorize their execution, setting permissions for the application. In some cases, applications can be divided into components which can be progressively downloaded. By providing application suggestions relevant to the current context and progressively downloading application components, applications can appear ambient, rather than relying on users to constantly download, install, or activate applications. Permissions for applications may be revoked permanently or for certain situations - either through user permissions selections or automatically in response to determined user intents. When multiple applications are simultaneously authorized to execute, the XR application system can employ a ranking system to prevent overcrowding.