Speech Interface Response Time Reduction via Predictive Vocalization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing speech recognition systems often exhibit slow and inconsistent response times, affecting the usability of speech interfaces in various environments.

Innovation Solution

A method and system that construct a partially completed word sequence from a partially received utterance using an automatic speech recognition detector and a rich predictive model to predict the remainder portion, allowing for timely responses through a natural language vocalization generator before the complete utterance is received.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the system waits for complete utterance recognition before generating a response, then the accuracy of speech recognition is improved, but the response time increases

Engineering Contradiction:
Improvespeech recognition accuracyVSAvoidresponse time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary speech recognition on the received portion of the utterance before the complete utterance is received. The processor begins constructing a word sequence from the partially received utterance and uses the predictive model to predict remaining words in advance, allowing response preparation to start earlier without waiting for complete utterance recognition.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system performs speech recognition and response generation on a partial utterance rather than waiting for the complete utterance. The processor works with the received portion of the utterance and uses predictive modeling to compensate for the incomplete input, enabling earlier response preparation while maintaining acceptable accuracy through the rich predictive model.

Inventive Principle:
Principle #16Partial or excessive action

2Reliability

If the system processes the complete utterance before responding, then the reliability of the response is improved, but the speed of response deteriorates

Engineering Contradiction:
Improveresponse reliabilityVSAvoidresponse speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The system introduces a predictive model as an intermediary between the partial speech input and the final response. The rich predictive model fills in the gaps of the incomplete utterance, allowing the system to generate reliable responses based on predicted complete utterances rather than waiting for actual complete input, thus improving speed while maintaining reliability through the predictive intermediary.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary processing of the utterance using the predictive model to generate a predicted complete utterance before the actual complete utterance is received. This preliminary action allows response preparation to begin earlier with higher confidence in the predicted content, improving both speed and reliability.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If the system uses a rich predictive model to predict the remainder portion, then the response time is reduced, but the device complexity increases

Engineering Contradiction:
Improveresponse timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The predictive model serves multiple functions within the speech interface system: it completes partial utterances, improves recognition accuracy, and enables earlier response preparation. By making this single component multi-functional, the system reduces response time without adding separate dedicated systems for each function, thereby managing complexity while achieving the desired performance improvement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11107473B2Approach to reducing the response time of a speech interface
Publication Date: 2021.08.31 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11107473B2 patent drawing
  • US11107473B2 patent drawing
  • US11107473B2 patent drawing

AI summary

A method for reducing response time in a speech interface including constructing a partially completed word sequence from a partially received utterance from a speaker received by an audio sensor, modeling a remainder portion using a processor based on a rich predictive model to predict the remainder portion, and responding to the partially completed word sequence and the predicted remainder portion using a natural language vocalization generator with a vocalization, wherein the vocalization is prepared before a complete utterance is received from the speaker and conveyed to the speaker by an audio transducer.