Intelligent Assistant Response Latency Reduction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Intelligent automated assistants on mobile platforms face challenges due to limited computing resources, resulting in increased response latency and a poor user experience.

Innovation Solution

The system receives a speech input, transmits its representation, and determines if the associated domain is linked to a predefined action; if so, it performs the action before receiving data content, allowing for quicker output to the user by receiving a domain signal prior to data content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If digital assistants are implemented on mobile platforms with limited computing resources, then portability and accessibility are improved, but response latency increases and user experience deteriorates

Engineering Contradiction:

ImproveportabilityVSAvoidresponse latency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by transmitting the speech representation to the server and receiving the domain signal before receiving the data content. This allows the device to prepare and execute predefined actions in advance, reducing the overall response latency when resources are limited.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The processing workflow is segmented into distinct phases: speech representation transmission, domain signal reception, predefined action determination, and data content reception. This segmentation allows mobile devices to handle only the critical early stages locally while delegating resource-intensive operations to remote servers.

Inventive Principle:

Principle #1Segmentation

2Reliability

If the system waits to receive data content before performing actions, then processing accuracy is improved, but response time increases

Engineering Contradiction:

Improveprocessing accuracyVSAvoidresponse time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by determining whether to execute predefined actions based on the domain signal received before the data content arrives. This allows the system to prepare and initiate actions in advance, reducing response time while maintaining processing accuracy through subsequent verification with the actual data content.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system performs partial actions by executing predefined actions based on the domain signal before receiving the complete data content. This partial execution reduces response time while the system can later adjust or refine the action based on the actual data content received.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS11231904B2Reducing response latency of intelligent automated assistants

Publication Date: 2022.01.25 APPLE INC

AI summary

Systems and processes for reducing response latency of intelligent automated assistants are provided. In one example process, a speech input containing a user request can be received from a user. A representation of the speech input can be transmitted. A domain signal representing a relevant domain associated with the user request can be received. The process can determine whether the relevant domain is associated with a predefined action of a set of predefined actions. In response to determining that the relevant domain is associated with a predefined action of a set of predefined actions, the predefined action can be performed. Data content relevant to satisfying the user request can be received. A result based on the data content can be outputted to at least partially satisfy the user request.