Mixed Reality Hologram Menus With Gaze-Aligned Rotation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality (MR) systems lack intuitive and adaptive user interfaces for interacting with holograms, particularly in head-mounted displays, where hologram menus often snap to fixed angles, requiring users to adjust their viewing position to access options, which can be cumbersome and limiting.
Innovation Solution
Implementing a system where hologram menus in MR devices rotate in a curved manner to face the user, aligning with their gaze direction, allowing seamless interaction without the need for users to reposition, and incorporating progressive disclosure of UI affordances to minimize overwhelming information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hologram menus are fixed at specific angles, then the system structure is simple, but the user must adjust viewing position to access options, reducing ease of operation
Solution Approach 1:
The hologram menu transitions from a static fixed-angle display to a dynamic system that automatically rotates and reorients based on the user's head position and gaze direction. The menu cards are configured to rotate about axes perpendicular to their display surfaces, enabling them to face the user from any viewing angle, thus eliminating the need for users to adjust their viewing position while maintaining intuitive interaction.
2Ease of operation
If hologram menus rotate to face the user, then ease of operation improves, but the mechanism becomes more complex
Solution Approach 1:
The patent replaces complex mechanical rotation mechanisms with software-based control. The system uses head-tracking technology to detect user gaze direction and programmatically rotates the holographic menu cards in the virtual space, eliminating the need for physical moving parts while achieving the same effect of presenting menu options facing the user from any angle.
3Loss of information
If all menu options are displayed simultaneously, then information completeness is high, but user cognitive load increases due to overwhelming information
Solution Approach 1:
The menu system is segmented into multiple hierarchical levels rather than presenting all options in a single overwhelming display. Users can access primary menu options first, then navigate to secondary and tertiary options as needed. This segmentation allows complete information to be available in the system while only presenting relevant subsets to the user at any given moment, reducing cognitive load while maintaining information completeness.
4Area of stationary object
If hologram menus are positioned far from the hologram, then interaction space is adequate, but the menu may be outside the user's field of view
Solution Approach 1:
The system implements real-time feedback by continuously monitoring the user's head position and gaze direction through head-tracking technology. Based on this feedback, the holographic menu cards automatically adjust their position and orientation in the virtual space to maintain optimal visibility within the user's field of view while preserving adequate interaction space. This dynamic positioning ensures menus remain accessible without requiring users to shift their gaze excessively.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The disclosed technology is generally directed to mixed reality devices. In one example of the technology, a mixed-reality view is provided to an operator. The mixed-reality view includes both a real-world environment of the operator and holographic aspects. The holographic aspects include at least a first hologram. The first hologram is displayed with a first hologram menu, such that the first hologram menu includes visible selectable menu options associated with the first hologram. In the mixed-reality view, the first hologram menu, including the visible selectable menu options of the first hologram menu, is rotated to face the operator as the operator moves, such that the first hologram menu rotates in a curved manner about the first hologram as the first hologram menu rotates. Responsive to the operator making a selection on the first hologram menu, the first hologram in the mixed-reality view is altered based on the selection.