AR Wearable Voice UI for Hands-Free Legacy App Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing AR wearable devices have limited physical user interface items and often require haptic interactions which are not feasible during activities like biking or jogging, and legacy applications lack voice UI support.

Innovation Solution

Implement a voice UI mode with voice labels for UI elements, using predetermined actions associated with each element, and a separate UI module to enable voice interaction for legacy applications without software updates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical user interface items are added to AR wearable devices, then ease of operation is improved, but device complexity increases

Engineering Contradiction:

Improveease of operationVSAvoiddevice complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical physical interface items with a voice-based interaction system. The voice UI module captures audio commands, processes them to identify UI element selections, and translates voice inputs into user interface interactions, eliminating the need for additional physical buttons or controls on the wearable device.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a voice UI module as an intermediary between the user and the UI elements. This module includes a voice recognizer that converts spoken commands into selections of UI elements, acting as a mediator that enables interaction without requiring direct physical contact with interface items.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If haptic interactions are used for UI control, then ease of operation is improved, but usability during activities like biking or jogging deteriorates

Engineering Contradiction:

Improveease of operationVSAvoidusability during activities

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent substitutes haptic mechanical interactions with acoustic/voice-based interactions. Users can control UI elements by speaking commands rather than physically manipulating buttons or switches, making the interface compatible with hands-free activities like biking or jogging while maintaining ease of operation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If voice UI support is added to legacy applications, then adaptability is improved, but device complexity increases

Engineering Contradiction:

ImproveadaptabilityVSAvoiddevice complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal voice UI module that can interface with both modern applications and legacy applications. The voice recognizer and UI element identifier work across different application types, providing a single multi-functional interface layer that enhances adaptability without requiring separate implementations for each application category.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent segments the voice interface functionality into a separate, standalone voice UI module that operates independently from individual applications. This modular approach allows the voice interface to be added to legacy applications without modifying the applications themselves, reducing the complexity impact on each individual component.

Inventive Principle:

Principle #1Segmentation

4Adaptability or versatility

If more UI elements are added to the interface, then functionality is improved, but ease of operation deteriorates due to limited physical controls

Engineering Contradiction:

ImprovefunctionalityVSAvoidease of operation

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces limited physical controls with voice-based selection mechanisms. Users can verbally select from multiple UI elements without physical buttons, allowing access to a larger set of functionality while maintaining ease of operation through natural speech interactions rather than constrained mechanical inputs.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20260003568A1Voice controlled uis for ar wearable devices

Publication Date: 2026.01.01 SNAP INC

AI summary

Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.