HMD Voice Command Feedback via ASR Audio Visual Cues

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing mobile computing devices face limitations in providing a hands-free, high-quality, portable, and large-format display experience due to their size and hands-dependent user interfaces, which restricts their ability to efficiently process and acknowledge voice commands.

Innovation Solution

A wireless computing headset with high-resolution micro-displays and integrated optics, capable of receiving voice commands and providing immediate feedback through visual and audio cues, such as automatic speech recognition notifications, to enhance user interaction and confidence in command recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a mobile computing device uses a hands-dependent user interface with keyboard or touch-screen, then data input and selection can be made, but user mobility is restricted and hands-free operation is not achieved

Engineering Contradiction:

Improvehands-free operation capabilityVSAvoiduser interface complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical hands-dependent interface (keyboard, touch-screen) with a voice-based acoustic interface. Users can issue commands through speech, and the system provides audio feedback, eliminating the need for manual interaction and enabling hands-free operation while reducing interface complexity.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Volume of moving object

If a mobile computing device reduces physical size to promote mobility, then portability is improved, but the ability to provide large-format high-resolution display is compromised

Engineering Contradiction:

Improvedevice physical sizeVSAvoiddisplay area

Core Design Contradiction:

Volume of moving objectVSArea of stationary object

Solution Approach 1:

The patent substitutes the visual display mechanism with an auditory feedback system. Instead of relying on a large physical display screen, the device uses speakers to provide audio feedback, notifications, and information delivery, allowing the device to remain compact while maintaining full information delivery capability through sound.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If the HMD provides immediate feedback for voice commands, then user interaction efficiency is improved, but processing time and system responsiveness requirements increase

Engineering Contradiction:

Improvecommand recognition speedVSAvoidfeedback delay

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent implements an immediate audio feedback system that acknowledges voice commands in real-time. The system provides confirmation sounds, repeats recognized commands, and delivers status updates through audio output, ensuring users receive instant confirmation of command recognition and system response, thereby improving interaction efficiency and reducing perceived delay.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10402162B2Automatic speech recognition (ASR) feedback for head mounted displays (HMD)

Publication Date: 2019.09.03 KOPIN CORP

AI summary

Feedback mechanisms to the user of a Head Mounted Display (HMD) are provided. It is important to provide feedback to the user when speech is recognized as soon as possible after the user utters a voice command. The HMD displays and/or audibly renders an ASR acknowledgment in a manner that ensures the user that the HMD has received/understood his voiced command.