Local Text-Response Maps for Low-Latency Voice Rendering

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Voice-based user interfaces in client devices face challenges with latency, resource consumption, and bandwidth usage due to reliance on remote systems for speech processing, especially in offline or low-bandwidth scenarios, leading to inefficient and power-intensive operations.

Innovation Solution

Implementing a local text-response map on the client device that stores mappings between previously processed spoken utterances and their corresponding responses, allowing for immediate rendering of responses without needing remote processing, except for dynamic or stale queries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a client-server approach is used for voice processing, then more complex speech recognition and semantic analysis functionality can be implemented, but latency increases and resources are consumed for protracted durations

Engineering Contradiction:

Improvespeech recognition functionalityVSAvoidlatency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent pre-processes and stores common speech queries and their responses in a local database on the client device. When a user speaks, the system first checks the local database for pre-computed responses, enabling immediate rendering without waiting for remote processing. This preliminary action resolves latency by providing instant responses for frequent queries while maintaining the ability to use remote systems for complex analysis when needed.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If a client-server approach is used for voice processing, then sophisticated semantic analysis can be performed, but bandwidth consumption increases significantly

Engineering Contradiction:

Improvesemantic analysis capabilityVSAvoidbandwidth consumption

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent extracts and stores frequently used speech queries and their corresponding responses in a local database on the client device. By taking out these common interactions from the remote processing pipeline and handling them locally, the system significantly reduces bandwidth consumption for routine queries while preserving the ability to send complex queries to the remote system when necessary.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements local processing capability by storing a database of pre-computed speech responses directly on the client device. This local quality enables the device to process common queries independently without requiring continuous communication with the remote system, thereby reducing bandwidth usage while maintaining sophisticated semantic analysis capability for queries that do have remote support.

Inventive Principle:

Principle #3Local quality

3Adaptability or versatility

If a client-server approach is used for voice processing, then comprehensive processing can be performed, but power consumption increases

Engineering Contradiction:

Improveprocessing capabilityVSAvoidpower consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary processing of common speech queries locally and stores the results in a database on the client device. This eliminates the need for continuous communication with and processing by the remote system for frequent queries, significantly reducing power consumption while maintaining comprehensive processing capability for queries that require remote assistance.

Inventive Principle:

Principle #10Preliminary action

4Adaptability or versatility

If continuous online connectivity is maintained for voice processing, then remote processing can be accessed, but connectivity requirements are not met in offline situations

Engineering Contradiction:

Improveremote processing accessVSAvoidoffline operation capability

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent pre-processes and stores common speech queries and responses in a local database on the client device. This preliminary action enables the system to operate reliably offline by providing instant responses for pre-computed queries without requiring any network connectivity, while still maintaining the ability to access remote processing capabilities when connectivity is available.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12462797B2Rendering responses to a spoken utterance of a user utilizing a local text-response map

Publication Date: 2025.11.04 GOOGLE LLC

AI summary

Implementations disclosed herein relate to generating and/or utilizing, by a client device, a text-response map that is stored locally on the client device. The text-response map can include a plurality of mappings, where each of the mappings define a corresponding direct relationship between corresponding text and a corresponding response. Each of the mappings is defined in the text-response map based on the corresponding text being previously generated from previous audio data captured by the client device and based on the corresponding response being previously received from a remote system in response to transmitting, to the remote system, at least one of the previous audio data and the corresponding text.