Speech Recognition Verb Error Recovery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current speech recognition systems often misinterpret verb-plus-object commands with errors, leading to compound errors where the system treats the command as dictation, requiring users to undo and re-speak, which frustrates users and complicates the interaction experience.

Innovation Solution

A computer-implemented method and system that maintains a set of verbs for speech recognition commands, providing inductive feedback when an invalid object is recognized with a verb, allowing users to specify how the verb and object should be treated, thereby preventing compound errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the system automatically determines whether speech is dictation or command without user indication, then user experience is simplified, but recognition errors occur when verb-plus-object commands are misinterpreted as dictation

Engineering Contradiction:
Improveuser experience simplificationVSAvoidrecognition accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system provides feedback to users when recognition ambiguity is detected, allowing users to clarify their intent. This resolves the contradiction by maintaining automatic classification benefits while adding a feedback loop to correct potential errors, thus improving reliability without sacrificing ease of operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary analysis of speech patterns to predict potential recognition errors before they occur. By detecting ambiguous verb-plus-object structures in advance, the system can proactively seek user clarification, preventing compound errors while maintaining the intuitive automatic classification approach.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If the system treats all unrecognized speech as dictation, then processing is simplified, but compound errors occur requiring users to undo and re-speak

Engineering Contradiction:
Improveprocessing complexityVSAvoiduser correction time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The system introduces feedback mechanisms that detect when automatic dictation treatment may be incorrect, particularly for verb-plus-object structures. This prevents compound errors by alerting users to potential misinterpretations, reducing the time users spend correcting errors while maintaining relatively simple processing logic.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system introduces an intermediary verification step between speech recognition and dictation insertion. This mediator checks for potential command structures before defaulting to dictation treatment, preventing compound errors without significantly increasing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the system provides detailed feedback about recognition uncertainty, then user control is improved, but interaction complexity increases

Engineering Contradiction:
Improveuser control flexibilityVSAvoidinteraction complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system provides targeted feedback only when recognition ambiguity is detected, rather than continuously. This improves user control flexibility by informing users when their input may be misinterpreted, while avoiding unnecessary interaction complexity by remaining silent when recognition is confident.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system applies feedback selectively only in cases of recognized ambiguity, rather than for all speech inputs. This partial application of feedback improves user control where needed while minimizing interaction complexity by avoiding unnecessary feedback in clear-cut cases.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8725505B2Verb error recovery in speech recognition
Publication Date: 2014.05.13 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8725505B2 patent drawing
  • US8725505B2 patent drawing
  • US8725505B2 patent drawing

AI summary

A computer implemented method and system for speech recognition are provided. The method and system generally maintain a set of verbs for speech recognition commands. Upon recognizing utterance of a verb of the set in combination with an invalid object or objects for the verb, the method and system generate an indication relative to the verb and invalid object. The indication can include informing the user that the system is unsure how to execute the command associated with the verb with the invalid object. The method and system can then receive a user input to specify how the verb and invalid object should be treated.