Voice-Controlled UI Labels for Hands-Free AR Wearable Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
AR wearable devices have limited physical user interface items and users often cannot use haptic UIs during activities, making it challenging to access numerous UI elements without manual interaction.
Innovation Solution
Implement a voice UI mode with voice labels for UI elements, allowing users to invoke actions via spoken commands, and a separate UI module to generate voice UI displays for legacy applications without software updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical user interface items are added to AR wearable devices, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The patent replaces mechanical physical interface items with a voice-based interaction system. The voice UI module captures spoken commands, processes them to identify UI element selections, and translates voice input into interaction actions, eliminating the need for additional physical buttons or controls on the wearable device.
Solution Approach 2:
The patent introduces a voice UI module as an intermediary between the user and the UI elements. This module includes a voice capture component, a processor that identifies selections based on voice input, and a translator that converts voice commands into interaction actions, serving as a mediator that enables operation without physical interface modifications.
2Ease of operation
If haptic UI interaction is supported, then ease of operation is improved, but usability during activities deteriorates
Solution Approach 1:
The patent replaces haptic mechanical interaction with acoustic/voice-based interaction. Users can control UI elements through spoken commands rather than physical touch or haptic feedback, enabling hands-free operation during activities such as cycling, running, or other tasks where manual dexterity is limited.
Solution Approach 2:
The patent enables dynamic adaptation of the interaction mode based on user needs and activity context. The voice UI module can activate or deactivate depending on the situation, allowing the system to transition between voice-based and traditional haptic interaction modes to optimize usability across different activity scenarios.
3Ease of operation
If voice UI mode is implemented, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The patent implements a universal voice UI module that can interface with existing applications and UI elements without requiring application-specific customization. The voice capture, processing, and translation components work across multiple applications, providing a single multi-functional interface that reduces overall system complexity despite adding voice capability.
Solution Approach 2:
The patent introduces a voice UI module as an intermediary layer between voice input and existing UI elements. This module handles voice capture, identifies selections, translates commands, and executes actions as a unified intermediate system, isolating the complexity of voice processing from the core application logic and minimizing impact on existing device architecture.
Data Source
AI summary
Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.