Digital Assistant Language Recognition Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital assistants often face latency issues when they incorrectly determine the language of a user's speech input, leading to inefficient user interactions and increased power consumption due to repeated inputs to correct recognition errors.

Innovation Solution

The method involves processing a natural language speech input using multiple language recognizers to determine recognition results in multiple languages, allowing users to quickly select the correct language and perform tasks without repeating the input, thereby reducing user input and power usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the digital assistant processes speech input using only a single language recognizer, then the device complexity and power consumption are reduced, but the reliability deteriorates when the language is incorrectly determined leading to latency issues

Engineering Contradiction:
Improvelanguage recognition accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by processing the speech input through multiple language recognizers simultaneously before final language determination. This parallel preprocessing allows the system to have recognition results ready for multiple languages, reducing latency when the initial language determination is incorrect and eliminating the need for users to repeat inputs.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the digital assistant uses multiple language recognizers simultaneously, then the reliability of language determination is improved, but the use of energy increases due to parallel processing operations

Engineering Contradiction:
Improvelanguage identification accuracyVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by using multiple language recognizers but only fully processing inputs where there is a genuine need for multilingual support or uncertainty. The system can selectively engage additional recognizers based on initial confidence scores, avoiding full parallel processing for all inputs and thus reducing overall power consumption while maintaining high reliability when needed.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If the digital assistant waits for complete speech processing before providing results, then the measurement precision of language determination is improved, but the speed of response deteriorates causing increased latency

Engineering Contradiction:
Improvelanguage determination accuracyVSAvoidresponse time
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent applies preliminary action by performing parallel language recognition processing before final language determination. Multiple language recognizers process the speech input simultaneously, and results are prepared in advance. This allows the system to quickly switch between language interpretations without requiring users to repeat inputs, thereby maintaining high measurement precision while significantly improving response speed.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If the digital assistant requires users to repeat speech input to correct language errors, then the measurement precision of language determination can be improved through multiple attempts, but the loss of time increases due to repeated interactions

Engineering Contradiction:
Improvelanguage recognition accuracyVSAvoiduser interaction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by preparing multiple language recognition results in advance before user confirmation is needed. When a user provides speech input, the system simultaneously processes it through multiple language recognizers and presents the top candidates. This eliminates the need for users to repeat inputs to correct language errors, thereby maintaining high measurement precision while minimizing time loss in user interactions.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11475884B2Reducing digital assistant latency when a language is incorrectly determined
Publication Date: 2022.10.18 APPLE INC
  • US11475884B2 patent drawing
  • US11475884B2 patent drawing
  • US11475884B2 patent drawing

AI summary

Systems and processes for operating an intelligent automated assistant are provided. An example process includes causing a first recognition result for a received natural language speech input to be displayed, where the first recognition result is in a first language and a second recognition result for the received natural language speech input is available for display responsive to receiving input indicative of user selection of the first recognition result, the second recognition result being in a second language. The example process further includes receiving the input indicative of user selection of the first recognition result and in response to receiving the input indicative of user selection of the first recognition result, causing the second recognition result to be displayed.