Voice-Navigable Menu for Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) face limitations in providing an efficient and intuitive user interface due to space constraints, making it difficult to navigate complex menus and invoke commands effectively, especially in wearable computing devices.
Innovation Solution
Implementing a voice-navigable user interface (VNUI) that uses a visible menu to display categories and commands, allowing users to utter phrases to navigate and invoke actions, with features like command prioritization based on frequency and recency of use, and the ability to invoke commands directly from the top-level menu.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a traditional visual menu interface is used in HMDs, then users can see and select menu items, but the limited display space makes it difficult to navigate complex menus and invoke commands efficiently
Solution Approach 1:
The menu system is segmented into multiple hierarchical levels (top-level menu, sub-menus, and command levels). Users can navigate through these segmented levels using voice commands, which resolves the space limitation by organizing content vertically across multiple menu layers rather than horizontally on a limited display area.
Solution Approach 2:
Voice commands serve as an intermediary mechanism between the user and the menu system. Instead of requiring direct visual interaction with the limited display, users speak commands that are processed by the system, effectively bypassing the display space constraint and enabling efficient navigation and command invocation.
2Adaptability or versatility
If more menu items and commands are displayed to provide comprehensive functionality, then the interface becomes more complex and harder to navigate, but displaying fewer items limits user access to commands
Solution Approach 1:
Commands are segmented into categories and organized in a hierarchical structure. The top-level menu presents simplified category options, while detailed commands are accessed through sub-menus. This segmentation allows comprehensive functionality to be maintained while keeping the visible interface simple and easy to navigate.
Solution Approach 2:
The menu system dynamically adapts its display based on user navigation. As users move through different menu levels, the displayed content changes to show relevant options. This dynamic behavior allows the interface to present simplified views at each level while providing access to the full range of commands through the hierarchical structure.
Data Source
AI summary
Methods, apparatus, and computer-readable media are described herein related to a user interface (UI) that can be implemented on a head-mountable device (HMD). The UI can include a voice-navigable UI. The voice-navigable UI can include a voice navigable menu that includes one or more menu items. The voice-navigable UI can also present a first visible menu that includes at least a portion of the voice navigable menu. In response to a first utterance comprising one of the one or more menu items, the voice-navigable UI can modify the first visible menu to display one or more commands associated with the first menu item. In response to a second utterance comprising a first command, the voice-navigable UI can invoke the first command. In some embodiments, the voice-navigable UI can display a second visible menu, where the first command can be displayed above other menu items in the second visible menu.