AR Headset Application Management via Spatial Field-of-View Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality near-eye display systems lack an efficient user interface for managing multiple applications, limiting user experience in terms of application activation, deactivation, and simultaneous use within a head-mounted display device.
Innovation Solution
A system and method that utilize a user interface to manage single or simultaneous applications in a head-mounted display device by tracking the user's head position and rotation, displaying application menus within the user's total field of view, allowing activation and deactivation of applications through visual cues and intuitive gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a traditional user interface is used for managing applications in an AR near-eye display, then the system structure remains simple, but the user experience deteriorates due to lack of intuitive application management and obstruction of real-world view
Solution Approach 1:
The patent transitions from traditional 2D screen-based interfaces to a 3D spatial interface that leverages the head-mounted display's field of view. Application menus are positioned at different depths and locations within the user's visual field, allowing intuitive selection through head movements and gaze direction without requiring complex manual interactions
Solution Approach 2:
The patent introduces virtual visual cues and menu elements as intermediaries between the user and applications. These virtual elements float in the user's field of view and provide contextual information about available applications, enabling seamless activation and management without physically obstructing the real-world view
2Ease of operation
If application menus are displayed in the user's field of view, then application activation becomes intuitive, but the real-world view becomes obstructed
Solution Approach 1:
The patent positions application menus and visual cues in specific peripheral regions of the user's field of view rather than blocking the central view. Different areas of the visual field serve different functions: central region maintains real-world visibility while peripheral regions display application controls, allowing users to manage applications without sacrificing situational awareness
Solution Approach 2:
The patent employs visual differentiation through color and brightness variations to distinguish virtual menu elements from the real-world environment. Virtual cues use distinct visual characteristics that make them easily identifiable yet semi-transparent or edge-placed, minimizing visual conflict and obstruction while maintaining intuitive interaction
3Adaptability or versatility
If multiple applications are managed simultaneously, then application versatility increases, but the user interface complexity increases
Solution Approach 1:
The patent divides the application management interface into separate functional zones within the field of view. Each zone handles specific tasks such as application selection, active application control, and background application management. This spatial segmentation allows users to manage multiple applications independently without overwhelming the interface or requiring complex hierarchical navigation
Data Source
AI summary
A system and method are provided that enhances a user's experience when using a see-through near eye display device. A user interface is provided for a user to manage single or simultaneous applications in a head mounted device. Applications for the head mounted device may be activated or deactivated by the user via the user-interface. The user's total field of view (TFOV) which accounts for a complete range of rotation and translation of the user's head may be determined by tracking the user's head position and rotation relative to the user's body and an environment associated with the user. One region of the user's TFOV (e.g., the right-hand side) may display an “application menu” including a list of applications that can be launched, and another region of the user's TFOV (e.g., the left-hand side) may display an “active menu” including a list of applications currently running.