Voice Command Visual Confirmation GUI Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Voice-activated computing devices lack visual confirmation of recognized voice-initiated actions, leading to uncertainty for users about the accuracy of executed commands.

Innovation Solution

A computing device outputs a speech recognition graphical user interface (GUI) with elements in a first visual format that change to a second format upon identifying a voice-initiated action, providing visual confirmation before executing the action.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If voice-activated computing devices execute commands without visual confirmation, then the device operation speed is improved, but user certainty about command accuracy deteriorates

Engineering Contradiction:
Improvedevice operation speedVSAvoiduser certainty about command accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent implements visual feedback by detecting when audio data matches a voice-initiated action and then displaying a visual indicator on the GUI. This feedback mechanism allows users to confirm that their voice command was accurately recognized and identified, resolving the contradiction by maintaining fast execution while improving user certainty through visual confirmation of command accuracy.

Inventive Principle:
Principle #23Feedback

2Reliability

If visual confirmation is added to voice-activated devices, then user confidence is improved, but device complexity increases

Engineering Contradiction:
Improveuser confidenceVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses the existing display interface as an intermediary to provide visual confirmation. Rather than adding complex new hardware or processing systems, the solution leverages the existing GUI infrastructure to render visual indicators when voice commands are recognized. This approach improves user confidence while minimizing increases in device complexity by reusing existing system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the system waits to provide visual confirmation before execution, then user verification ability is improved, but response time increases

Engineering Contradiction:
Improveuser verification abilityVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent provides visual confirmation during the audio data reception phase, before the voice-initiated action is executed. By displaying the visual indicator while the system is still receiving and processing audio data, users can verify command accuracy in advance without delaying the subsequent execution. This preliminary visual confirmation resolves the contradiction by enabling user verification before execution while maintaining rapid response times.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3028136B1Visual confirmation for a recognized voice-initiated action
Publication Date: 2019.09.25 GOOGLE LLC
  • EP3028136B1 patent drawingFigure 1
  • EP3028136B1 patent drawingFigure 2
  • EP3028136B1 patent drawingFigure 3

AI summary

Techniques described herein provide a computing device configured to provide an indication that the computing device has recognized a voice-initiated action. In one example, a method is provided for outputting, by a computing device and for display, a speech recognition graphical user interface (GUI) having at least one element in a first visual format. The method further includes receiving, by the computing device, audio data and determining, by the computing device, a voice-initiated action based on the audio data. The method also includes outputting, while receiving additional audio data and prior to executing a voice-initiated action based on the audio data, and for display, an updated speech recognition GUI in which the at least one element is displayed in a second visual format, different from the first visual format, to indicate that the voice-initiated action has been identified.