Adaptive Extended Reality Shortcuts for Faster Command Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Extended reality systems face challenges in designing and assigning efficient shortcuts due to diverse environments, user variance, and context-dependent interactions, leading to suboptimal user experience.

Innovation Solution

A predictive model is used to collect personalized usage data, estimate interaction times, and determine optimal shortcut assignments based on user preferences and interaction patterns, optimizing the graphical user interface for seamless and efficient interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces with menus, toolbars, and icons are used in extended reality systems, then users can access functionality and commands, but accessing these commands requires significant time and effort

Engineering Contradiction:
Improveease of accessing commandsVSAvoidtime to access commands
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system pre-assigns shortcut keys to frequently used commands and functionalities based on usage data analysis. This preliminary assignment allows users to access commands directly through keyboard shortcuts without navigating through menus, toolbars, or icons, significantly reducing access time and effort while maintaining ease of operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements shortcut key mechanisms that replicate the efficiency of traditional desktop computing shortcuts within the extended reality environment. By copying the proven shortcut paradigm from conventional interfaces into the XR context, users can leverage familiar keyboard-based quick access methods, eliminating the need to interact with complex visual interfaces.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If static shortcut assignments are used in extended reality systems, then implementation is simple, but the system cannot adapt to diverse environments, user variance, and context-dependent interactions

Engineering Contradiction:
Improveadaptability to user preferences and contextsVSAvoidcomplexity of shortcut assignment system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The shortcut assignment system dynamically adapts to user behavior by continuously monitoring usage patterns and automatically reassigning shortcuts based on observed preferences and contextual factors. This dynamic adjustment mechanism allows the system to evolve and personalize shortcut assignments for each user without requiring manual configuration, thereby achieving high adaptability while managing complexity through automated processes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback loops that monitor user interactions with commands and shortcuts, analyzing usage frequency and success patterns. This feedback information is fed back into the shortcut assignment algorithm, which automatically adjusts and optimizes shortcut assignments to better match user preferences and contextual requirements, enabling continuous improvement of system adaptability.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If comprehensive usage data collection is implemented to personalize shortcuts, then optimal shortcut assignments can be determined, but data collection and processing requirements increase

Engineering Contradiction:
Improveprecision of user interaction measurementVSAvoidcomplexity of data processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The data collection and processing system is segmented into modular components: data collection modules that capture specific interaction events, data storage modules that organize usage information, and analysis modules that process patterns independently. This segmentation allows precise measurement of user interactions while distributing processing complexity across separate, manageable system components rather than requiring a monolithic complex system.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12444144B2Designing and optimizing adaptive shortcuts for extended reality
Publication Date: 2025.10.14 META PLATFORMS TECHNOLOGIES LLC
  • US12444144B2 patent drawing
  • US12444144B2 patent drawing
  • US12444144B2 patent drawing

AI summary

Disclosed herein is an extended reality system, and associated techniques, whereby personalized usage data of a user in one or more extended reality environments over a period of time can be collected and provided to a predictive model to determine optimal shortcut assignments for presentation to and subsequent use by the user. Determining the optimal shortcut assignments can involve estimating a plurality of interaction times for the user in the one or more extended reality environments, generating an optimized graphical user interface within the one or more extended reality environments with the optimal shortcut assignments reflected in the optimized graphical user interface, and rendering the optimized graphical user interface in the one or more extended reality environments to the user. The system may collect additional personalized usage data and periodically update the optimal shortcut assignments based on ongoing use of the system by the user.